-- Logs begin at Thu 2022-06-02 09:21:19 UTC, end at Thu 2022-06-02 10:37:18 UTC. -- Jun 02 09:52:56.051737 dv-cinder-797608-25-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 09:52:56.062200 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 09:52:56 2022] *** Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: nodename: dv-cinder-797608-25-iscsi Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: machine: x86_64 Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: clock source: unix Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: pcre jit disabled Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: detected number of CPU cores: 4 Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: current working directory: / Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: detected binary path: /usr/bin/uwsgi-core Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: your processes number limit is 47680 Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: your memory page size is 4096 bytes Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: detected max file descriptor number: 2048 Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: lock engine: pthread robust mutexes Jun 02 09:52:56.062736 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: thunder lock: enabled Jun 02 09:52:56.063586 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 09:52:56.063586 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 09:52:56.107229 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: Python main interpreter initialized at 0x555c14d3d9c0 Jun 02 09:52:56.107229 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: python threads support enabled Jun 02 09:52:56.107229 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: your server socket listen backlog is limited to 100 connections Jun 02 09:52:56.107229 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: your mercy for graceful operations on workers is 90 seconds Jun 02 09:52:56.110494 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 09:52:56.110494 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: *** Operational MODE: preforking *** Jun 02 09:52:56.110494 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: *** uWSGI is running in multiple interpreter mode *** Jun 02 09:52:56.110494 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: spawned uWSGI master process (pid: 80284) Jun 02 09:52:56.110494 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: spawned uWSGI worker 1 (pid: 80295, cores: 1) Jun 02 09:52:56.110494 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: spawned uWSGI worker 2 (pid: 80296, cores: 1) Jun 02 09:52:56.110494 dv-cinder-797608-25-iscsi devstack@keystone.service[80284]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 09:52:56.108119 dv-cinder-797608-25-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 02 09:53:01.799024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:53:01.799024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: from cryptography.utils import int_from_bytes Jun 02 09:53:01.799848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:53:01.799848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: from cryptography.utils import int_from_bytes Jun 02 09:53:01.800277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:53:01.800277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: from cryptography.utils import int_from_bytes Jun 02 09:53:01.800385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:53:01.800385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: from cryptography.utils import int_from_bytes Jun 02 09:53:01.849038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 09:53:01.849229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 09:53:01.849312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 09:53:01.849404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] command line args: [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 09:53:01.849482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 09:53:01.849614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] command line args: [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 09:53:01.849698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 09:53:01.849836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ================================================================================ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 09:53:01.849929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 09:53:01.850048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ================================================================================ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 09:53:01.850133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] admin_token = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.850306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] admin_token = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.850391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] config_dir = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.850492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.850581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] config_dir = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.850658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] config_source = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.850733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.850840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] debug = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.850923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] config_source = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.851038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.851299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] debug = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.851299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.851455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.851520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.851588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.851731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.851838 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.851941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_config_append = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_config_append = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_dir = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.852987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_dir = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.853088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.853671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.853784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.853903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.853986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.854979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.855197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.855291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.855457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.855542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.855691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.856035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.856193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.856273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.856428 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.856575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.856953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.857031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.857110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.857169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.857279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.857358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.857427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.857640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.857820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] publish_errors = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.857902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.858054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.858138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] publish_errors = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.858285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.858368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.858463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.858548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.858699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.858776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.858934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.859018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] standard_threads = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] standard_threads = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_journal = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.892952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_json = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893090 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_journal = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_stderr = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_json = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] use_syslog = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_stderr = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] use_syslog = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.893670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:53:01.893744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.893819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.893888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.893956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.894964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.895937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896652 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.896998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.897967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.898992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.899085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.899221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.899319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.899420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.899521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.899617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.899760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.899886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900583 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.900957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.901954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902019 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902090 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902583 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.902959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.903936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.904958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905146 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905922 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.905991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906795 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.906946 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.907972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.908945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909239 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909463 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.909943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.external = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.external = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.910956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.password = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] auth.token = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.password = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] auth.token = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.911976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.912979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.913940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.914987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.915069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.915192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.915265 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.915335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.915416 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.915494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.915573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.916967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.917977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.918974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.919995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.920961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921466 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.921954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922394 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922913 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.922990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.923969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924111 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.924969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925398 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.925974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.926966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927885 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.927961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928237 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928447 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928593 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928806 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928875 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.928944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.929936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930152 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930376 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.930934 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.931014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.931144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.931221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.931882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.931967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] role.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] role.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932267 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] role.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] role.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.932987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933421 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.933931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934491 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.934976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935718 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935858 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.935928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936646 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.936939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937228 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937298 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937806 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.937955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.938938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.939970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940694 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.940986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941855 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.941995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 09:53:01.942647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:53:01.942647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 09:53:01.964526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:01.964756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:01.964982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:01.965321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:01.965556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:01.965793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:01.973441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:01.974261 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.002799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.003028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.003581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.003818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.057105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.057443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.106345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.106458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.106578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.106691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.173234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.173460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.173684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.173768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.173893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.173977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.174109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.174204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.174325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.174408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.174614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.174831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.197378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.197610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.197700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.197835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.197918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.198059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.198143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.198281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.198364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.198501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.198599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.198714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.198796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.198931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.209982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.210378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.223024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.223288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.223509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.223615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.223730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.223821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.223950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.224032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.224167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.224249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.224380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.224464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.224599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.224820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:53:02.242348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.242558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 09:53:02.242834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.242918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.243044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 09:53:02.243151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 09:53:02.243375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.243469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.243603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 09:53:02.243685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.243905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.243988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.244158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.244247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.244411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.244665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.255187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.255464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.255707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.255799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.255987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.256076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.256264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.256579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.265557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.266173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.267436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.267716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.267988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.268073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.268264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.268349 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.268542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.268636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.268818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.268902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.269094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.269175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.269445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.269535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.269713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.269794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.269986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.270066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.270250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.270332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.270540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.270806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.298135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.298348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.299894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.300109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.300197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.300386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.305484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.305720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.305808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.306006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.306093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.306311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.313446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.313678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.313764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.313955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.318310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.318697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.318784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.318980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.319125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.319292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.319402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.319582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.319664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.319846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.319937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.320116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.320208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.320392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.320475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.320732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.339583 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.339859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.339945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.340215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.344527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.344895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.348199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.348489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.348573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.348866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.354034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.354464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.357939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.358363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.363072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.363394 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.363540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.363681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.363844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.363968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.364133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.364237 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.364420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.364517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.364705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.364985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.383423 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.383703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.383962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.384047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.384221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.384320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.384528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.384800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.392336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.392788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.394057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.394330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.394519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.394795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.397431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.397714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.397898 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.397983 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.398186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.398271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.398478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.398572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.398756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.399036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.412434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.412720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.412927 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.413012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.413210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.413296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.413489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.413576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.413765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.413852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.414038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.414121 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.414307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.414576 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.432814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.433454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.436093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.436752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.439431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.440098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.441050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.441704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.442685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.442961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.443271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.443390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.443665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.443943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.450681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.451396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.452332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.453016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.455537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.455826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.456106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.456235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.456391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.456524 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.456809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.457085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.465988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.466272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.466654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.466738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.466964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.467371 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.474679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.474958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.475259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.475361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:53:02.475535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.475621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.475804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.475891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.476074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.476167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.476342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.476429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.476617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.476701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.476887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.476971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.477150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.477232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.477415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.477511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.477682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.477767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.477948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.478030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.478767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.478861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.479041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.479325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:53:02.516715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c14d3d9c0 pid: 80296 (default app) Jun 02 09:53:02.517165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c14d3d9c0 pid: 80295 (default app) Jun 02 09:53:02.519955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bce3c-c8d6-47cd-bbda-cb60ace7d9dd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.520248 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bce3c-c8d6-47cd-bbda-cb60ace7d9dd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.520522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bce3c-c8d6-47cd-bbda-cb60ace7d9dd None None] PATH_INFO: `/v3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.524785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Thu Jun 2 09:53:02 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:11.374423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408280b0-b50f-4f94-bff1-d6ba246a8763 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:11.374962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408280b0-b50f-4f94-bff1-d6ba246a8763 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:11.374962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408280b0-b50f-4f94-bff1-d6ba246a8763 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:11.379392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:11.385381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:11.385774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:11.385929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:11.453910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: INFO dbcounter [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] Registered counter for database keystone Jun 02 09:53:11.474608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG oslo_db.sqlalchemy.engines [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:53:11.481014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writer thread running {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:53:11.760683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG passlib.handlers.bcrypt [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80296) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 09:53:11.761097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG passlib.handlers.bcrypt [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80296) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 09:53:11.816608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:11.818210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:11.941282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 557 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 02 09:53:12.114411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408280b0-b50f-4f94-bff1-d6ba246a8763 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:12.182173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: INFO dbcounter [None req-408280b0-b50f-4f94-bff1-d6ba246a8763 None None] Registered counter for database keystone Jun 02 09:53:12.201027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG oslo_db.sqlalchemy.engines [None req-408280b0-b50f-4f94-bff1-d6ba246a8763 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:53:12.207148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writer thread running {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:53:12.428491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408280b0-b50f-4f94-bff1-d6ba246a8763 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:12.432656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d97ea-02ff-4d68-9064-d6762912d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:12.433301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d97ea-02ff-4d68-9064-d6762912d27f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:12.433582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d97ea-02ff-4d68-9064-d6762912d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:12.433854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d97ea-02ff-4d68-9064-d6762912d27f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:12.441731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d97ea-02ff-4d68-9064-d6762912d27f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:12.492894 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c95d97ea-02ff-4d68-9064-d6762912d27f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 09:53:12.493227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d97ea-02ff-4d68-9064-d6762912d27f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:12.502358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Jun 2 09:53:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:53:12.508826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:12.522915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29750c1-58ef-49e9-8756-451702ca75d4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:12.527980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a383-37d9-455f-a9b6-8295e3a82f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:12.529114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a383-37d9-455f-a9b6-8295e3a82f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:12.529424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a383-37d9-455f-a9b6-8295e3a82f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:12.529696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a383-37d9-455f-a9b6-8295e3a82f09 admin admin] PATH_INFO: `/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:12.531261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872a383-37d9-455f-a9b6-8295e3a82f09 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4fcfbbe473b47bea6be4001c8a8fd93)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:12.582187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6872a383-37d9-455f-a9b6-8295e3a82f09 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 09:53:12.582535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872a383-37d9-455f-a9b6-8295e3a82f09 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:12.587814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Thu Jun 2 09:53:12 2022] GET /identity/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:14.776563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e946b-b51b-4015-85b6-be07a05fac88 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:14.777101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e946b-b51b-4015-85b6-be07a05fac88 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:14.777101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e946b-b51b-4015-85b6-be07a05fac88 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:14.781229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:14.786576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d71f5-3fe1-4028-bed8-ac066453afb1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:14.786988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d71f5-3fe1-4028-bed8-ac066453afb1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:14.787186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d71f5-3fe1-4028-bed8-ac066453afb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:14.805935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2e2d71f5-3fe1-4028-bed8-ac066453afb1 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:14.807498 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2e2d71f5-3fe1-4028-bed8-ac066453afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:14.815238 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 09:53:14.838017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e946b-b51b-4015-85b6-be07a05fac88 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:14.850187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e946b-b51b-4015-85b6-be07a05fac88 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:14.854691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119e778-e8f1-438e-865c-b5eb9c5850fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:14.855360 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e778-e8f1-438e-865c-b5eb9c5850fb admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:14.855647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e778-e8f1-438e-865c-b5eb9c5850fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:14.855924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e778-e8f1-438e-865c-b5eb9c5850fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:14.863683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119e778-e8f1-438e-865c-b5eb9c5850fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:14.865443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119e778-e8f1-438e-865c-b5eb9c5850fb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:14.874109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Thu Jun 2 09:53:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:53:14.879509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d71f5-3fe1-4028-bed8-ac066453afb1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:14.888963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d71f5-3fe1-4028-bed8-ac066453afb1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:14.893413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f661-b37e-4945-be38-04a9cec66638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:14.894268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f661-b37e-4945-be38-04a9cec66638 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:14.894550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f661-b37e-4945-be38-04a9cec66638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:14.894825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f661-b37e-4945-be38-04a9cec66638 admin admin] PATH_INFO: `/v3/users/8ee8c41befe5418c95bad9a434d99f95` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:14.896234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16f661-b37e-4945-be38-04a9cec66638 admin admin] RBAC: Authorizing `identity:get_user(user_id=8ee8c41befe5418c95bad9a434d99f95)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:14.898030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16f661-b37e-4945-be38-04a9cec66638 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:14.900206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Thu Jun 2 09:53:14 2022] GET /identity/v3/users/8ee8c41befe5418c95bad9a434d99f95 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:17.182284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c468ceb-e87b-4448-a12f-f7901290f759 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.182831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c468ceb-e87b-4448-a12f-f7901290f759 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.182924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c468ceb-e87b-4448-a12f-f7901290f759 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.184234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:17.189430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096cf49-eb8f-4c35-b250-cc4bef81d821 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.189820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096cf49-eb8f-4c35-b250-cc4bef81d821 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.189978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096cf49-eb8f-4c35-b250-cc4bef81d821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.206815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2096cf49-eb8f-4c35-b250-cc4bef81d821 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:17.207992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2096cf49-eb8f-4c35-b250-cc4bef81d821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:17.217706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670071f-ba8a-40c6-b163-d284699dfce4 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.217994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670071f-ba8a-40c6-b163-d284699dfce4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.218274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670071f-ba8a-40c6-b163-d284699dfce4 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.219643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:17.224633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1870c-f75f-44ec-9b64-f44b012644ff None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.224918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1870c-f75f-44ec-9b64-f44b012644ff None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.225191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1870c-f75f-44ec-9b64-f44b012644ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.267452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG passlib.handlers.bcrypt [None req-96a1870c-f75f-44ec-9b64-f44b012644ff None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80295) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 09:53:17.267878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG passlib.handlers.bcrypt [None req-96a1870c-f75f-44ec-9b64-f44b012644ff None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80295) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 09:53:17.288271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:17.311487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096cf49-eb8f-4c35-b250-cc4bef81d821 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.314486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-96a1870c-f75f-44ec-9b64-f44b012644ff None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:17.316110 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-96a1870c-f75f-44ec-9b64-f44b012644ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:17.334708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.414067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096cf49-eb8f-4c35-b250-cc4bef81d821 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.415262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:17.437267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1870c-f75f-44ec-9b64-f44b012644ff None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.448056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65834c-074e-4dd5-b1f3-291c1495e205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.448851 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65834c-074e-4dd5-b1f3-291c1495e205 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.449131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65834c-074e-4dd5-b1f3-291c1495e205 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.449405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65834c-074e-4dd5-b1f3-291c1495e205 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.460199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65834c-074e-4dd5-b1f3-291c1495e205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-df65834c-074e-4dd5-b1f3-291c1495e205 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:17.471115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:17.472037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:17.474180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:17.475057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:17.479655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65834c-074e-4dd5-b1f3-291c1495e205 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.536393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1870c-f75f-44ec-9b64-f44b012644ff None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.538672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.560553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.573368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1d8f2-ba5a-4dd6-ae05-90678ba7c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.574255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1d8f2-ba5a-4dd6-ae05-90678ba7c210 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.574535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1d8f2-ba5a-4dd6-ae05-90678ba7c210 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.574808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1d8f2-ba5a-4dd6-ae05-90678ba7c210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.578216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65834c-074e-4dd5-b1f3-291c1495e205 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.612052 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8164553-0442-4d93-8451-de3190639b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.612713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8164553-0442-4d93-8451-de3190639b31 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.612993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8164553-0442-4d93-8451-de3190639b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.613269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8164553-0442-4d93-8451-de3190639b31 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.614014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8164553-0442-4d93-8451-de3190639b31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:17.614322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8164553-0442-4d93-8451-de3190639b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:17.615819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8164553-0442-4d93-8451-de3190639b31 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:17.629313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:17.635306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8164553-0442-4d93-8451-de3190639b31 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.641544 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1d8f2-ba5a-4dd6-ae05-90678ba7c210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:17.643056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1d8f2-ba5a-4dd6-ae05-90678ba7c210 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:17.733046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8164553-0442-4d93-8451-de3190639b31 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.740110 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:17.745634 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1d8f2-ba5a-4dd6-ae05-90678ba7c210 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.748244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.768226 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13862f-e21e-4f18-9dac-2e8db1dd92f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.769100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13862f-e21e-4f18-9dac-2e8db1dd92f1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.769385 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13862f-e21e-4f18-9dac-2e8db1dd92f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.769661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13862f-e21e-4f18-9dac-2e8db1dd92f1 None admin] PATH_INFO: `/v3/users/8ee8c41befe5418c95bad9a434d99f95` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.770985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13862f-e21e-4f18-9dac-2e8db1dd92f1 None admin] RBAC: Authorizing `identity:get_user(user_id=8ee8c41befe5418c95bad9a434d99f95)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:17.772479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13862f-e21e-4f18-9dac-2e8db1dd92f1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:17.774713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/users/8ee8c41befe5418c95bad9a434d99f95 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:17.780659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13862f-e21e-4f18-9dac-2e8db1dd92f1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.794960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.847589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1d8f2-ba5a-4dd6-ae05-90678ba7c210 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.880372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13862f-e21e-4f18-9dac-2e8db1dd92f1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.884019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950f69-b6e7-4408-8674-b931decf85ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.887386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950f69-b6e7-4408-8674-b931decf85ab None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.887386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950f69-b6e7-4408-8674-b931decf85ab None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.887386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950f69-b6e7-4408-8674-b931decf85ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.904360 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68950f69-b6e7-4408-8674-b931decf85ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:17.905816 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68950f69-b6e7-4408-8674-b931decf85ab None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:17.920290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3602dcd-dacd-42d2-a127-1e0dc4650b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.921122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3602dcd-dacd-42d2-a127-1e0dc4650b37 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.921405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3602dcd-dacd-42d2-a127-1e0dc4650b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.921678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3602dcd-dacd-42d2-a127-1e0dc4650b37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.922843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3602dcd-dacd-42d2-a127-1e0dc4650b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:17.924352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3602dcd-dacd-42d2-a127-1e0dc4650b37 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:17.925951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-68950f69-b6e7-4408-8674-b931decf85ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:53:17.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:17.927378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:17.928246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:53:17.928246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:53:17.928246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:53:17.928246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:17.928246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:17.932405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3602dcd-dacd-42d2-a127-1e0dc4650b37 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.934732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950f69-b6e7-4408-8674-b931decf85ab None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.994443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.013655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.031782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3602dcd-dacd-42d2-a127-1e0dc4650b37 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.036947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950f69-b6e7-4408-8674-b931decf85ab None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.065864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730dafd-6261-4184-9f0a-2ec8566390c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.066591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730dafd-6261-4184-9f0a-2ec8566390c8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.066883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730dafd-6261-4184-9f0a-2ec8566390c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.067188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730dafd-6261-4184-9f0a-2ec8566390c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.068040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730dafd-6261-4184-9f0a-2ec8566390c8 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.domain.id=default, user.id=8ee8c41befe5418c95bad9a434d99f95) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:18.068322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730dafd-6261-4184-9f0a-2ec8566390c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.069761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730dafd-6261-4184-9f0a-2ec8566390c8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.069872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8a116-0edf-4944-bc45-145193dc9861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.071171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8a116-0edf-4944-bc45-145193dc9861 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.071458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8a116-0edf-4944-bc45-145193dc9861 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.071731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8a116-0edf-4944-bc45-145193dc9861 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.072450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8a116-0edf-4944-bc45-145193dc9861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:18.072752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8a116-0edf-4944-bc45-145193dc9861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.074123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8a116-0edf-4944-bc45-145193dc9861 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.077190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/role_assignments?user.id=8ee8c41befe5418c95bad9a434d99f95&scope.domain.id=default&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:18.093039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:20.555494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed4ec3-ca5f-468f-b904-19197a2f14d7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.556049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed4ec3-ca5f-468f-b904-19197a2f14d7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.556049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed4ec3-ca5f-468f-b904-19197a2f14d7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.557740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:20.562737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b64f04-44b2-4620-90f5-4d80c43c9075 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.563131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b64f04-44b2-4620-90f5-4d80c43c9075 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.563329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b64f04-44b2-4620-90f5-4d80c43c9075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.588255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-71b64f04-44b2-4620-90f5-4d80c43c9075 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:20.589462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-71b64f04-44b2-4620-90f5-4d80c43c9075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:20.687797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:20.732594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed4ec3-ca5f-468f-b904-19197a2f14d7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:20.780848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51bec8-6d03-400a-88b6-25d86a1ae3ac None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.781158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51bec8-6d03-400a-88b6-25d86a1ae3ac None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.781408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51bec8-6d03-400a-88b6-25d86a1ae3ac None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.782777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:20.788431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19e16d-133c-4bf1-b3d0-0878842ec981 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.788979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19e16d-133c-4bf1-b3d0-0878842ec981 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.789476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19e16d-133c-4bf1-b3d0-0878842ec981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.834225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3c19e16d-133c-4bf1-b3d0-0878842ec981 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:20.834225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3c19e16d-133c-4bf1-b3d0-0878842ec981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:20.892034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed4ec3-ca5f-468f-b904-19197a2f14d7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:20.913971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:20.962979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ab641-491f-4fe2-aba9-8b102672e1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:20.963835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ab641-491f-4fe2-aba9-8b102672e1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.964119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ab641-491f-4fe2-aba9-8b102672e1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.964398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ab641-491f-4fe2-aba9-8b102672e1d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.965248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:20.966725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fe124-18b3-4e55-b875-f855e1e72e16 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.967008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fe124-18b3-4e55-b875-f855e1e72e16 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.967307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fe124-18b3-4e55-b875-f855e1e72e16 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.973963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 14/26] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:20.975249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2270b5-3390-4336-8b63-6ebf9e2a989e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.975539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2270b5-3390-4336-8b63-6ebf9e2a989e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.975864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2270b5-3390-4336-8b63-6ebf9e2a989e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.984209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ab641-491f-4fe2-aba9-8b102672e1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b07ab641-491f-4fe2-aba9-8b102672e1d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:20.999792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:21.000854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:21.001814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:21.004206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 13/27] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:21.005127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ab641-491f-4fe2-aba9-8b102672e1d2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:21.007957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3b2270b5-3390-4336-8b63-6ebf9e2a989e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:21.009308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3b2270b5-3390-4336-8b63-6ebf9e2a989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:21.025518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:21.111984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 15/28] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:21.118244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2270b5-3390-4336-8b63-6ebf9e2a989e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:21.263723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2270b5-3390-4336-8b63-6ebf9e2a989e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:21.276465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:21.314822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb7e0-758d-45d6-935d-7050135d5517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:21.317070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb7e0-758d-45d6-935d-7050135d5517 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:21.317571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb7e0-758d-45d6-935d-7050135d5517 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:21.318063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb7e0-758d-45d6-935d-7050135d5517 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:21.319084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fb7e0-758d-45d6-935d-7050135d5517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:21.320346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fb7e0-758d-45d6-935d-7050135d5517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:21.321938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fb7e0-758d-45d6-935d-7050135d5517 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:21.338110 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 16/29] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:21.339505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb7e0-758d-45d6-935d-7050135d5517 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:21.342590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ab641-491f-4fe2-aba9-8b102672e1d2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:21.411066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85304b87-1e2e-4ffc-96d7-f4819e819e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:21.412251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85304b87-1e2e-4ffc-96d7-f4819e819e9d None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:21.412541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85304b87-1e2e-4ffc-96d7-f4819e819e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:21.412823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85304b87-1e2e-4ffc-96d7-f4819e819e9d None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:21.414107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85304b87-1e2e-4ffc-96d7-f4819e819e9d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:21.423258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85304b87-1e2e-4ffc-96d7-f4819e819e9d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:21.534145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb7e0-758d-45d6-935d-7050135d5517 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:21.579879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00029db-215a-4a57-aa53-f6b6db5288d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:21.580692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00029db-215a-4a57-aa53-f6b6db5288d7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:21.580967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00029db-215a-4a57-aa53-f6b6db5288d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:21.581241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00029db-215a-4a57-aa53-f6b6db5288d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:21.611128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00029db-215a-4a57-aa53-f6b6db5288d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:21.614027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00029db-215a-4a57-aa53-f6b6db5288d7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a00029db-215a-4a57-aa53-f6b6db5288d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:53:21.652433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:21.653286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:21.654079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:53:21.654079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:53:21.654079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:53:21.654079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:21.660881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 17/30] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:21.661789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00029db-215a-4a57-aa53-f6b6db5288d7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:21.675884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 14/31] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 2 09:53:21 2022] POST /identity/v3/roles => generated 219 bytes in 671 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:21.678025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492143d-b9ad-42a9-a0df-0e497d186235 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:21.678463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492143d-b9ad-42a9-a0df-0e497d186235 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:21.679295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492143d-b9ad-42a9-a0df-0e497d186235 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:21.681279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 15/32] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:21.687551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492143d-b9ad-42a9-a0df-0e497d186235 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:21.718920 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:21.813030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492143d-b9ad-42a9-a0df-0e497d186235 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:21.832049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:21.855132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed9e2d-131b-43e3-a738-dbb6c9e5494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:21.856244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9e2d-131b-43e3-a738-dbb6c9e5494b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:21.856893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9e2d-131b-43e3-a738-dbb6c9e5494b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:21.858874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9e2d-131b-43e3-a738-dbb6c9e5494b None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:21.859910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed9e2d-131b-43e3-a738-dbb6c9e5494b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:21.861431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed9e2d-131b-43e3-a738-dbb6c9e5494b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:21.863430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed9e2d-131b-43e3-a738-dbb6c9e5494b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:21.882710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00029db-215a-4a57-aa53-f6b6db5288d7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:21.905643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 16/33] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:21.907089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac22e40-080e-414f-8ee5-fafb79f1c23a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:21.913857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac22e40-080e-414f-8ee5-fafb79f1c23a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:21.913857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac22e40-080e-414f-8ee5-fafb79f1c23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:21.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bac22e40-080e-414f-8ee5-fafb79f1c23a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:21.938794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bac22e40-080e-414f-8ee5-fafb79f1c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:21.948971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608c5bf-cf99-4983-ac36-d3b06ee783b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:21.949935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c5bf-cf99-4983-ac36-d3b06ee783b0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:21.950220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c5bf-cf99-4983-ac36-d3b06ee783b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:21.950492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c5bf-cf99-4983-ac36-d3b06ee783b0 None admin] PATH_INFO: `/v3/users/8ee8c41befe5418c95bad9a434d99f95` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:21.954883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608c5bf-cf99-4983-ac36-d3b06ee783b0 None admin] RBAC: Authorizing `identity:get_user(user_id=8ee8c41befe5418c95bad9a434d99f95)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:21.957588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608c5bf-cf99-4983-ac36-d3b06ee783b0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:21.961537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 18/34] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:21 2022] GET /identity/v3/users/8ee8c41befe5418c95bad9a434d99f95 => generated 247 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:21.962142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608c5bf-cf99-4983-ac36-d3b06ee783b0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:22.037179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 17/35] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:22.039239 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac22e40-080e-414f-8ee5-fafb79f1c23a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:22.088300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:22.101477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608c5bf-cf99-4983-ac36-d3b06ee783b0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:22.122761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:22.144084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddac83c-9560-4437-9737-ac1b80105100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:22.144304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddac83c-9560-4437-9737-ac1b80105100 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.144457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddac83c-9560-4437-9737-ac1b80105100 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.145249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddac83c-9560-4437-9737-ac1b80105100 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.146093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddac83c-9560-4437-9737-ac1b80105100 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:22.148286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddac83c-9560-4437-9737-ac1b80105100 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:22.180951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac22e40-080e-414f-8ee5-fafb79f1c23a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:22.222882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9880b-22d2-4fc4-b36c-8a04d910cfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:22.223955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9880b-22d2-4fc4-b36c-8a04d910cfeb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.224309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9880b-22d2-4fc4-b36c-8a04d910cfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.224598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9880b-22d2-4fc4-b36c-8a04d910cfeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.225834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9880b-22d2-4fc4-b36c-8a04d910cfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:22.227335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9880b-22d2-4fc4-b36c-8a04d910cfeb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:22.229392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 18/36] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:22.233602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9880b-22d2-4fc4-b36c-8a04d910cfeb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:22.337053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9880b-22d2-4fc4-b36c-8a04d910cfeb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:22.363900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:22.377393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5d45-4317-48d2-b7c4-705b6af735d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:22.378081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5d45-4317-48d2-b7c4-705b6af735d5 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.378370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5d45-4317-48d2-b7c4-705b6af735d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.378651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5d45-4317-48d2-b7c4-705b6af735d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.385755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:53:21 2022] POST /identity/v3/projects => generated 301 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:22.385960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf5d45-4317-48d2-b7c4-705b6af735d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:22.386066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddac83c-9560-4437-9737-ac1b80105100 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:22.386149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf5d45-4317-48d2-b7c4-705b6af735d5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:22.456822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 19/38] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 2 09:53:22 2022] POST /identity/v3/roles => generated 225 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:22.458299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629813d-7037-4941-9473-7bdbceabc376 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.458789 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629813d-7037-4941-9473-7bdbceabc376 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.459202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629813d-7037-4941-9473-7bdbceabc376 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.461107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 20/39] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:22.467433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5493-4f4a-498c-aa00-c80fd1870a02 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.467883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5493-4f4a-498c-aa00-c80fd1870a02 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.468268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5493-4f4a-498c-aa00-c80fd1870a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.489138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e9de5493-4f4a-498c-aa00-c80fd1870a02 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:22.490899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e9de5493-4f4a-498c-aa00-c80fd1870a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:22.515129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddac83c-9560-4437-9737-ac1b80105100 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:22.568411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e4093-c215-4edb-b910-9769f2ac9700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:22.569333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e4093-c215-4edb-b910-9769f2ac9700 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.571278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e4093-c215-4edb-b910-9769f2ac9700 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.571278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e4093-c215-4edb-b910-9769f2ac9700 None admin] PATH_INFO: `/v3/domains/default/users/8ee8c41befe5418c95bad9a434d99f95/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.580016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e4093-c215-4edb-b910-9769f2ac9700 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8ee8c41befe5418c95bad9a434d99f95, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:22.581681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e4093-c215-4edb-b910-9769f2ac9700 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:22.593996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 21/40] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:22.617803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5493-4f4a-498c-aa00-c80fd1870a02 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:22.693929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:22.700159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 20/41] 10.222.0.13 () {58 vars in 1361 bytes} [Thu Jun 2 09:53:22 2022] PUT /identity/v3/domains/default/users/8ee8c41befe5418c95bad9a434d99f95/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:22.740569 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5493-4f4a-498c-aa00-c80fd1870a02 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:22.756671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:22.773039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450727-4c78-4349-816b-90beffe7d073 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.773399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450727-4c78-4349-816b-90beffe7d073 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.773615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450727-4c78-4349-816b-90beffe7d073 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.775069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 21/42] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:22.781210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b1b9-0104-47ee-af2f-38af4aa76b00 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.781908 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b1b9-0104-47ee-af2f-38af4aa76b00 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.782198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b1b9-0104-47ee-af2f-38af4aa76b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.790213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229a684-e63b-4f4a-aa3b-bd2fd2a85716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:22.790919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229a684-e63b-4f4a-aa3b-bd2fd2a85716 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.791277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229a684-e63b-4f4a-aa3b-bd2fd2a85716 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.791522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229a684-e63b-4f4a-aa3b-bd2fd2a85716 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.792299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229a684-e63b-4f4a-aa3b-bd2fd2a85716 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:22.793701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229a684-e63b-4f4a-aa3b-bd2fd2a85716 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:22.806304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7664b1b9-0104-47ee-af2f-38af4aa76b00 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:22.814417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7664b1b9-0104-47ee-af2f-38af4aa76b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:22.874897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 22/43] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 2 09:53:22 2022] POST /identity/v3/roles => generated 223 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:53:22.883775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 22/44] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:22.907544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229a684-e63b-4f4a-aa3b-bd2fd2a85716 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:23.022931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229a684-e63b-4f4a-aa3b-bd2fd2a85716 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:23.059804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e8294-37b1-48b0-bace-16efecc3ae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:23.060674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e8294-37b1-48b0-bace-16efecc3ae1e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.060949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e8294-37b1-48b0-bace-16efecc3ae1e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.061221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e8294-37b1-48b0-bace-16efecc3ae1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.062425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e8294-37b1-48b0-bace-16efecc3ae1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:23.063927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e8294-37b1-48b0-bace-16efecc3ae1e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:23.070131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 23/45] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:23.071627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b1b9-0104-47ee-af2f-38af4aa76b00 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:23.177495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b1b9-0104-47ee-af2f-38af4aa76b00 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:23.205475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:23.211768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87b595-e477-4aab-9769-9649aab2f3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:23.212432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b595-e477-4aab-9769-9649aab2f3b7 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.212719 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b595-e477-4aab-9769-9649aab2f3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.213026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87b595-e477-4aab-9769-9649aab2f3b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.219557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87b595-e477-4aab-9769-9649aab2f3b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:23.219557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87b595-e477-4aab-9769-9649aab2f3b7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:23.296995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:53:23 2022] POST /identity/v3/projects => generated 312 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:53:24.968917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba73d96-c640-4629-854b-67f2569dc464 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.969430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba73d96-c640-4629-854b-67f2569dc464 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.969535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba73d96-c640-4629-854b-67f2569dc464 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.970834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 24/47] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:24.976753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90c43-be47-459c-8099-bcbbce49adc8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.977165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90c43-be47-459c-8099-bcbbce49adc8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.977314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90c43-be47-459c-8099-bcbbce49adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.993895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-38c90c43-be47-459c-8099-bcbbce49adc8 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:24.995064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-38c90c43-be47-459c-8099-bcbbce49adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:25.061525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:25.087757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba73d96-c640-4629-854b-67f2569dc464 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.134995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.192101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba73d96-c640-4629-854b-67f2569dc464 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.226306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd634841-9c2a-4a80-9bdb-019965d78c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.227065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd634841-9c2a-4a80-9bdb-019965d78c93 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.227679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd634841-9c2a-4a80-9bdb-019965d78c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.228130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd634841-9c2a-4a80-9bdb-019965d78c93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.240900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd634841-9c2a-4a80-9bdb-019965d78c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bd634841-9c2a-4a80-9bdb-019965d78c93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:25.248801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:25.249726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:25.250460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 25/49] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:25.257618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90c43-be47-459c-8099-bcbbce49adc8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.353880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90c43-be47-459c-8099-bcbbce49adc8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.366340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.386710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb517ab-f998-4c1a-a11f-5875ed6cfe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.387407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb517ab-f998-4c1a-a11f-5875ed6cfe17 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.387688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb517ab-f998-4c1a-a11f-5875ed6cfe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.387959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb517ab-f998-4c1a-a11f-5875ed6cfe17 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.388694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb517ab-f998-4c1a-a11f-5875ed6cfe17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:25.388995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb517ab-f998-4c1a-a11f-5875ed6cfe17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.390351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb517ab-f998-4c1a-a11f-5875ed6cfe17 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.403319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 25/50] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:25.404668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd634841-9c2a-4a80-9bdb-019965d78c93 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.499758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.502667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd634841-9c2a-4a80-9bdb-019965d78c93 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.535485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e879a8-0045-42a2-8170-c671f27d9753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.536351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e879a8-0045-42a2-8170-c671f27d9753 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.536632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e879a8-0045-42a2-8170-c671f27d9753 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.536907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e879a8-0045-42a2-8170-c671f27d9753 None admin] PATH_INFO: `/v3/users/8ee8c41befe5418c95bad9a434d99f95` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.538110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e879a8-0045-42a2-8170-c671f27d9753 None admin] RBAC: Authorizing `identity:get_user(user_id=8ee8c41befe5418c95bad9a434d99f95)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.540170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e879a8-0045-42a2-8170-c671f27d9753 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.541366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 26/51] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/users/8ee8c41befe5418c95bad9a434d99f95 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:25.546528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb517ab-f998-4c1a-a11f-5875ed6cfe17 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.572808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f97d-c36b-41d3-9de8-d6cee794446d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.573101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f97d-c36b-41d3-9de8-d6cee794446d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.573387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326f97d-c36b-41d3-9de8-d6cee794446d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.574750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 27/52] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:25.579675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9cd6f-dc24-4c79-9e23-b85715ffc57d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.579965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9cd6f-dc24-4c79-9e23-b85715ffc57d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.580245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9cd6f-dc24-4c79-9e23-b85715ffc57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.597061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-66f9cd6f-dc24-4c79-9e23-b85715ffc57d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:25.598257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-66f9cd6f-dc24-4c79-9e23-b85715ffc57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:25.646964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb517ab-f998-4c1a-a11f-5875ed6cfe17 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.664706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 28/53] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:25.679286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199561b7-5688-403c-837f-ba38917be07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.680077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199561b7-5688-403c-837f-ba38917be07d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.680356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199561b7-5688-403c-837f-ba38917be07d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.680629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199561b7-5688-403c-837f-ba38917be07d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.681798 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199561b7-5688-403c-837f-ba38917be07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.683274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199561b7-5688-403c-837f-ba38917be07d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.684869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 26/54] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:25.688524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9cd6f-dc24-4c79-9e23-b85715ffc57d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.690281 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199561b7-5688-403c-837f-ba38917be07d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.731895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.784352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.789075 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9cd6f-dc24-4c79-9e23-b85715ffc57d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.789266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199561b7-5688-403c-837f-ba38917be07d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.822209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d9e4a-7cee-4e49-b7a6-634ed007d44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.822532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0b5f9-ac93-4e6c-b4b8-df63b3fa409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.822994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d9e4a-7cee-4e49-b7a6-634ed007d44f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.823211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b5f9-ac93-4e6c-b4b8-df63b3fa409d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.823374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d9e4a-7cee-4e49-b7a6-634ed007d44f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.823533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b5f9-ac93-4e6c-b4b8-df63b3fa409d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.823681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d9e4a-7cee-4e49-b7a6-634ed007d44f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.823819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0b5f9-ac93-4e6c-b4b8-df63b3fa409d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.824650 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0b5f9-ac93-4e6c-b4b8-df63b3fa409d None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.domain.id=default, user.id=8ee8c41befe5418c95bad9a434d99f95) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:25.824856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d9e4a-7cee-4e49-b7a6-634ed007d44f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.824952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0b5f9-ac93-4e6c-b4b8-df63b3fa409d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.826277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d9e4a-7cee-4e49-b7a6-634ed007d44f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.826386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0b5f9-ac93-4e6c-b4b8-df63b3fa409d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.827971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 29/55] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:25.833616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d9e4a-7cee-4e49-b7a6-634ed007d44f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.841721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 27/56] 10.222.0.13 () {56 vars in 1322 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/role_assignments?user.id=8ee8c41befe5418c95bad9a434d99f95&scope.domain.id=default&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:25.945780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d9e4a-7cee-4e49-b7a6-634ed007d44f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.981388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9cf93-8ec1-44a1-af0f-c2085ef4548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.982071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9cf93-8ec1-44a1-af0f-c2085ef4548b None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.982355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9cf93-8ec1-44a1-af0f-c2085ef4548b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.982632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9cf93-8ec1-44a1-af0f-c2085ef4548b None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.983393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9cf93-8ec1-44a1-af0f-c2085ef4548b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.984853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9cf93-8ec1-44a1-af0f-c2085ef4548b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:26.057978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 30/57] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Jun 2 09:53:25 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:53:28.268950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136ebc-d44c-4b7e-bc47-94c1f0e5460f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.269396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136ebc-d44c-4b7e-bc47-94c1f0e5460f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.269503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136ebc-d44c-4b7e-bc47-94c1f0e5460f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.270887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 28/58] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:28.276604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868956-594f-4e85-b583-d973a34d2d10 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.276968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868956-594f-4e85-b583-d973a34d2d10 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.277166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80868956-594f-4e85-b583-d973a34d2d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.293630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-80868956-594f-4e85-b583-d973a34d2d10 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:28.294818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-80868956-594f-4e85-b583-d973a34d2d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:28.307656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:28.360414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 31/59] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:28.384674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16136ebc-d44c-4b7e-bc47-94c1f0e5460f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:28.483337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16136ebc-d44c-4b7e-bc47-94c1f0e5460f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:28.489885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:28.516617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5cab2-6574-40f9-b1ed-a0be6dc602a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:28.517343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5cab2-6574-40f9-b1ed-a0be6dc602a4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.517673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5cab2-6574-40f9-b1ed-a0be6dc602a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.518134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5cab2-6574-40f9-b1ed-a0be6dc602a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.519808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5cab2-6574-40f9-b1ed-a0be6dc602a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:28.521254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5cab2-6574-40f9-b1ed-a0be6dc602a4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:28.522857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 29/60] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:28.528104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868956-594f-4e85-b583-d973a34d2d10 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:28.622001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80868956-594f-4e85-b583-d973a34d2d10 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:28.654137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a7426-f898-405b-8559-c7f61a3d644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:28.654789 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a7426-f898-405b-8559-c7f61a3d644d None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.655070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a7426-f898-405b-8559-c7f61a3d644d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.655376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a7426-f898-405b-8559-c7f61a3d644d None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.656083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a7426-f898-405b-8559-c7f61a3d644d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:28.657526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a7426-f898-405b-8559-c7f61a3d644d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:28.758627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 32/61] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:28 2022] POST /identity/v3/users => generated 275 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:53:32.071951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c1e50-cdeb-4194-b6d9-a17052b7f898 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.072988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c1e50-cdeb-4194-b6d9-a17052b7f898 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.073497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c1e50-cdeb-4194-b6d9-a17052b7f898 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.075086 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 30/62] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:32.080795 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6248-e47e-4b48-aa32-19b58a20005c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.081659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6248-e47e-4b48-aa32-19b58a20005c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.082137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6248-e47e-4b48-aa32-19b58a20005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.093870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.108006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7a8a6248-e47e-4b48-aa32-19b58a20005c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:32.109419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7a8a6248-e47e-4b48-aa32-19b58a20005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:32.197445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 33/63] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:32.246422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c1e50-cdeb-4194-b6d9-a17052b7f898 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.388468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c1e50-cdeb-4194-b6d9-a17052b7f898 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.389376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71b18-a7b3-424c-b6bb-33b871eb3a2e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.389757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71b18-a7b3-424c-b6bb-33b871eb3a2e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.390115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71b18-a7b3-424c-b6bb-33b871eb3a2e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.391867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 34/64] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:32.397702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79b698-eec9-4b74-b54d-add954306390 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.398061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79b698-eec9-4b74-b54d-add954306390 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.398422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79b698-eec9-4b74-b54d-add954306390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.431573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5d79b698-eec9-4b74-b54d-add954306390 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:32.432839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5d79b698-eec9-4b74-b54d-add954306390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:32.446973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b84a08-da1f-4366-9392-61bfa5b8fa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.447828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84a08-da1f-4366-9392-61bfa5b8fa0f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.448113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84a08-da1f-4366-9392-61bfa5b8fa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.448391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84a08-da1f-4366-9392-61bfa5b8fa0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.461376 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b84a08-da1f-4366-9392-61bfa5b8fa0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d9b84a08-da1f-4366-9392-61bfa5b8fa0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:32.470984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:32.471856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:32.472604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 31/65] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:32.473704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92e652-20a1-426d-a92d-c433ebd8feb3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.477788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92e652-20a1-426d-a92d-c433ebd8feb3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.477788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92e652-20a1-426d-a92d-c433ebd8feb3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.480573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 32/66] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:32.483218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18215d-9728-4771-aa77-87ca0ec537d7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.483583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18215d-9728-4771-aa77-87ca0ec537d7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.483932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18215d-9728-4771-aa77-87ca0ec537d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.501106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3c18215d-9728-4771-aa77-87ca0ec537d7 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:32.502429 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3c18215d-9728-4771-aa77-87ca0ec537d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:32.510403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 35/67] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:32.511251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79b698-eec9-4b74-b54d-add954306390 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.550057 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.586367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.597766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 33/68] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:32.599048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18215d-9728-4771-aa77-87ca0ec537d7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.619442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79b698-eec9-4b74-b54d-add954306390 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.656683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca5d4d-93af-462d-be4c-1f983813b285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.657293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5d4d-93af-462d-be4c-1f983813b285 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.657651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5d4d-93af-462d-be4c-1f983813b285 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.657997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5d4d-93af-462d-be4c-1f983813b285 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.658756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca5d4d-93af-462d-be4c-1f983813b285 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:32.659064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca5d4d-93af-462d-be4c-1f983813b285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:32.660487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca5d4d-93af-462d-be4c-1f983813b285 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:32.669256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 36/69] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:32.672771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34103f21-d20d-4eb7-8547-07611ab11870 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.676356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34103f21-d20d-4eb7-8547-07611ab11870 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.676356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34103f21-d20d-4eb7-8547-07611ab11870 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.676356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 37/70] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:32.676981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34103f21-d20d-4eb7-8547-07611ab11870 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.708499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18215d-9728-4771-aa77-87ca0ec537d7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.747464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21d7b6-8fec-4c3b-ad13-eead9bb7cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.748324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21d7b6-8fec-4c3b-ad13-eead9bb7cc09 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.748543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21d7b6-8fec-4c3b-ad13-eead9bb7cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.748813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21d7b6-8fec-4c3b-ad13-eead9bb7cc09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.760306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21d7b6-8fec-4c3b-ad13-eead9bb7cc09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-7e21d7b6-8fec-4c3b-ad13-eead9bb7cc09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:32.768353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:32.769224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:32.770052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 34/71] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:32.770655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21d7b6-8fec-4c3b-ad13-eead9bb7cc09 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.794261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34103f21-d20d-4eb7-8547-07611ab11870 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.795634 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.819596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.828131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab490c-d090-4925-b2da-154416d3c35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.828939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab490c-d090-4925-b2da-154416d3c35b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.829222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab490c-d090-4925-b2da-154416d3c35b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.829501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab490c-d090-4925-b2da-154416d3c35b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.840780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab490c-d090-4925-b2da-154416d3c35b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2eab490c-d090-4925-b2da-154416d3c35b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:32.848825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:32.849702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:32.850464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 38/72] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:32.851429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5d13b-3806-4a64-b3d5-46192a3deb65 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.851716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5d13b-3806-4a64-b3d5-46192a3deb65 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.851990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5d13b-3806-4a64-b3d5-46192a3deb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.868359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ece5d13b-3806-4a64-b3d5-46192a3deb65 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:32.869533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ece5d13b-3806-4a64-b3d5-46192a3deb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:32.874178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21d7b6-8fec-4c3b-ad13-eead9bb7cc09 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.908809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d87f8-fd63-48b0-8b82-a874dcfe9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.909619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d87f8-fd63-48b0-8b82-a874dcfe9374 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.909905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d87f8-fd63-48b0-8b82-a874dcfe9374 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.910180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d87f8-fd63-48b0-8b82-a874dcfe9374 None admin] PATH_INFO: `/v3/users/ad64baa998df4ef985f8ebf3cab5798b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.925780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d87f8-fd63-48b0-8b82-a874dcfe9374 None admin] RBAC: Authorizing `identity:get_user(user_id=ad64baa998df4ef985f8ebf3cab5798b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:32.927278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d87f8-fd63-48b0-8b82-a874dcfe9374 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:32.932734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 35/73] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/users/ad64baa998df4ef985f8ebf3cab5798b => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:32.932734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b200-051b-4bc6-9b21-85446815b357 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.932734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b200-051b-4bc6-9b21-85446815b357 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.932734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b200-051b-4bc6-9b21-85446815b357 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.932734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 36/74] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:32.933107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21b200-051b-4bc6-9b21-85446815b357 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.945429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 39/75] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:32.951960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5d13b-3806-4a64-b3d5-46192a3deb65 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.015717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.033992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21b200-051b-4bc6-9b21-85446815b357 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.049449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5d13b-3806-4a64-b3d5-46192a3deb65 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.065875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.068068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020de44-b970-4ef1-a13a-87f406261635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.069318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020de44-b970-4ef1-a13a-87f406261635 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.069604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020de44-b970-4ef1-a13a-87f406261635 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.069882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020de44-b970-4ef1-a13a-87f406261635 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.070632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020de44-b970-4ef1-a13a-87f406261635 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:33.070936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020de44-b970-4ef1-a13a-87f406261635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.072345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020de44-b970-4ef1-a13a-87f406261635 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.080254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 37/76] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.081035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020de44-b970-4ef1-a13a-87f406261635 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.083915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdab11-a4cd-4d8b-acbc-d8aca3558f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.084647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdab11-a4cd-4d8b-acbc-d8aca3558f7c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.084951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdab11-a4cd-4d8b-acbc-d8aca3558f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.085227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdab11-a4cd-4d8b-acbc-d8aca3558f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.085982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdab11-a4cd-4d8b-acbc-d8aca3558f7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:33.086293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdab11-a4cd-4d8b-acbc-d8aca3558f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.087736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdab11-a4cd-4d8b-acbc-d8aca3558f7c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.100478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 40/77] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.101774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c291421-3c8f-437a-9cf8-65a52c7d17b2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.102065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c291421-3c8f-437a-9cf8-65a52c7d17b2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.102345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c291421-3c8f-437a-9cf8-65a52c7d17b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.118932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8c291421-3c8f-437a-9cf8-65a52c7d17b2 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:33.120211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8c291421-3c8f-437a-9cf8-65a52c7d17b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:33.180218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020de44-b970-4ef1-a13a-87f406261635 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.185667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 41/78] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:33.197123 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c291421-3c8f-437a-9cf8-65a52c7d17b2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.224747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44510e32-2f25-45ca-8f1a-4f3ecb4be510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.225397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44510e32-2f25-45ca-8f1a-4f3ecb4be510 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.225678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44510e32-2f25-45ca-8f1a-4f3ecb4be510 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.225947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44510e32-2f25-45ca-8f1a-4f3ecb4be510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.239893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.288932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c291421-3c8f-437a-9cf8-65a52c7d17b2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.293707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44510e32-2f25-45ca-8f1a-4f3ecb4be510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.295199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44510e32-2f25-45ca-8f1a-4f3ecb4be510 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.298178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.322535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2589e-a4b3-4a1e-bebe-7686e1c8d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.323356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2589e-a4b3-4a1e-bebe-7686e1c8d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.323707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2589e-a4b3-4a1e-bebe-7686e1c8d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.323911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2589e-a4b3-4a1e-bebe-7686e1c8d7c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.334317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2589e-a4b3-4a1e-bebe-7686e1c8d7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-69c2589e-a4b3-4a1e-bebe-7686e1c8d7c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:33.341825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:33.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:33.343658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 42/79] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:33.344291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2589e-a4b3-4a1e-bebe-7686e1c8d7c5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.396044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 38/80] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:33.396909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44510e32-2f25-45ca-8f1a-4f3ecb4be510 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.440504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.446345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2589e-a4b3-4a1e-bebe-7686e1c8d7c5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.478988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46376ded-f17d-4746-9117-245ab5f099ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.479876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46376ded-f17d-4746-9117-245ab5f099ec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.480162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46376ded-f17d-4746-9117-245ab5f099ec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.480440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46376ded-f17d-4746-9117-245ab5f099ec None admin] PATH_INFO: `/v3/users/ad64baa998df4ef985f8ebf3cab5798b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.481644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46376ded-f17d-4746-9117-245ab5f099ec None admin] RBAC: Authorizing `identity:get_user(user_id=ad64baa998df4ef985f8ebf3cab5798b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.483112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46376ded-f17d-4746-9117-245ab5f099ec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.484783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 43/81] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/users/ad64baa998df4ef985f8ebf3cab5798b => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.485542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46376ded-f17d-4746-9117-245ab5f099ec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.497957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44510e32-2f25-45ca-8f1a-4f3ecb4be510 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.519151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.531202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56806ba6-cc64-46d7-b659-e6b9a0b0c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.532068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56806ba6-cc64-46d7-b659-e6b9a0b0c133 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.532349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56806ba6-cc64-46d7-b659-e6b9a0b0c133 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.532726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56806ba6-cc64-46d7-b659-e6b9a0b0c133 None admin] PATH_INFO: `/v3/users/ad64baa998df4ef985f8ebf3cab5798b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.533799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56806ba6-cc64-46d7-b659-e6b9a0b0c133 None admin] RBAC: Authorizing `identity:get_user(user_id=ad64baa998df4ef985f8ebf3cab5798b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.535335 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56806ba6-cc64-46d7-b659-e6b9a0b0c133 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.537469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 39/82] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/users/ad64baa998df4ef985f8ebf3cab5798b => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.538270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56806ba6-cc64-46d7-b659-e6b9a0b0c133 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.588000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46376ded-f17d-4746-9117-245ab5f099ec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.622092 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a337e9-b22d-4974-8813-63c861f9d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.622880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a337e9-b22d-4974-8813-63c861f9d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.623190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a337e9-b22d-4974-8813-63c861f9d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.623472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a337e9-b22d-4974-8813-63c861f9d2c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.624633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a337e9-b22d-4974-8813-63c861f9d2c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.626081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a337e9-b22d-4974-8813-63c861f9d2c2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.627718 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 44/83] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.628472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a337e9-b22d-4974-8813-63c861f9d2c2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.635136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56806ba6-cc64-46d7-b659-e6b9a0b0c133 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.648660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.669410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2fa2-2e53-4f33-8f0a-a3d04e8e40f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.670081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2fa2-2e53-4f33-8f0a-a3d04e8e40f2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.670368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2fa2-2e53-4f33-8f0a-a3d04e8e40f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.670649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2fa2-2e53-4f33-8f0a-a3d04e8e40f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.671426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2fa2-2e53-4f33-8f0a-a3d04e8e40f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:33.671737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2fa2-2e53-4f33-8f0a-a3d04e8e40f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.673146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2fa2-2e53-4f33-8f0a-a3d04e8e40f2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.681492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 40/84] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.682277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2fa2-2e53-4f33-8f0a-a3d04e8e40f2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.732342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a337e9-b22d-4974-8813-63c861f9d2c2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.734521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.765693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be896b4-1308-40bd-8455-dae8a95a31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.766567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be896b4-1308-40bd-8455-dae8a95a31a1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.766852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be896b4-1308-40bd-8455-dae8a95a31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.767157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be896b4-1308-40bd-8455-dae8a95a31a1 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.768357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be896b4-1308-40bd-8455-dae8a95a31a1 None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.769811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be896b4-1308-40bd-8455-dae8a95a31a1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.772208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 45/85] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.772811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be896b4-1308-40bd-8455-dae8a95a31a1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.780854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2fa2-2e53-4f33-8f0a-a3d04e8e40f2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.814215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870d23-23ec-4f46-b30a-2a6d10fd78e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.814859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870d23-23ec-4f46-b30a-2a6d10fd78e4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.815178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870d23-23ec-4f46-b30a-2a6d10fd78e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.815460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870d23-23ec-4f46-b30a-2a6d10fd78e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.857913 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.872080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be896b4-1308-40bd-8455-dae8a95a31a1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.882003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95870d23-23ec-4f46-b30a-2a6d10fd78e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.883530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95870d23-23ec-4f46-b30a-2a6d10fd78e4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.905711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beae3f-7e74-4d7a-8909-54acfb0aa32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.906364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beae3f-7e74-4d7a-8909-54acfb0aa32c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.906649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beae3f-7e74-4d7a-8909-54acfb0aa32c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.906926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beae3f-7e74-4d7a-8909-54acfb0aa32c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.947287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.972714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beae3f-7e74-4d7a-8909-54acfb0aa32c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.974189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beae3f-7e74-4d7a-8909-54acfb0aa32c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.982706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 41/86] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:33.983617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870d23-23ec-4f46-b30a-2a6d10fd78e4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.055822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.075282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 46/87] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:34.076124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beae3f-7e74-4d7a-8909-54acfb0aa32c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.081328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870d23-23ec-4f46-b30a-2a6d10fd78e4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.115975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74dafb-d499-4600-80a6-65744830be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.116649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74dafb-d499-4600-80a6-65744830be19 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.116929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74dafb-d499-4600-80a6-65744830be19 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.117203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74dafb-d499-4600-80a6-65744830be19 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.117912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74dafb-d499-4600-80a6-65744830be19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.119382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74dafb-d499-4600-80a6-65744830be19 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.145735 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.173688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beae3f-7e74-4d7a-8909-54acfb0aa32c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.203227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 42/88] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:33 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:34.204162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74dafb-d499-4600-80a6-65744830be19 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.206479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31d87a-9ca9-40b1-889c-f04e092a6341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.207397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31d87a-9ca9-40b1-889c-f04e092a6341 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.207683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31d87a-9ca9-40b1-889c-f04e092a6341 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.208619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31d87a-9ca9-40b1-889c-f04e092a6341 None admin] PATH_INFO: `/v3/users/8ee8c41befe5418c95bad9a434d99f95` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.209817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31d87a-9ca9-40b1-889c-f04e092a6341 None admin] RBAC: Authorizing `identity:get_user(user_id=8ee8c41befe5418c95bad9a434d99f95)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.211325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31d87a-9ca9-40b1-889c-f04e092a6341 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.213106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 47/89] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/users/8ee8c41befe5418c95bad9a434d99f95 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.214589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31d87a-9ca9-40b1-889c-f04e092a6341 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.328674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31d87a-9ca9-40b1-889c-f04e092a6341 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.329014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74dafb-d499-4600-80a6-65744830be19 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.360604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.365773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29a7e-89b9-4428-b19e-41447e49469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.366612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29a7e-89b9-4428-b19e-41447e49469a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.366899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29a7e-89b9-4428-b19e-41447e49469a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.367207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29a7e-89b9-4428-b19e-41447e49469a None admin] PATH_INFO: `/v3/projects/f5484221369c40e6a5c6a9c6c372cd84` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.367326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879f68c-6904-4369-9ae3-7e070d302d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.367916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f68c-6904-4369-9ae3-7e070d302d52 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.368201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f68c-6904-4369-9ae3-7e070d302d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.368494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad29a7e-89b9-4428-b19e-41447e49469a None admin] RBAC: Authorizing `identity:get_project(project_id=f5484221369c40e6a5c6a9c6c372cd84)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.368602 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f68c-6904-4369-9ae3-7e070d302d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.369318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879f68c-6904-4369-9ae3-7e070d302d52 None admin] RBAC: Adding query filter params (role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=372aa814f19d46d68ffb05087f0d23f8, user.id=ad64baa998df4ef985f8ebf3cab5798b) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:34.369626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879f68c-6904-4369-9ae3-7e070d302d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.369971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad29a7e-89b9-4428-b19e-41447e49469a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.371188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879f68c-6904-4369-9ae3-7e070d302d52 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.379756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 48/90] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/projects/f5484221369c40e6a5c6a9c6c372cd84 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.379756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29a7e-89b9-4428-b19e-41447e49469a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.382580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 43/91] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/role_assignments?user.id=ad64baa998df4ef985f8ebf3cab5798b&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.386768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879f68c-6904-4369-9ae3-7e070d302d52 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.389982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.531291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29a7e-89b9-4428-b19e-41447e49469a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.533230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879f68c-6904-4369-9ae3-7e070d302d52 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.572289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c54625-9867-4a5d-baed-e497f0d574be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.574167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c54625-9867-4a5d-baed-e497f0d574be None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.574167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c54625-9867-4a5d-baed-e497f0d574be None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.574167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c54625-9867-4a5d-baed-e497f0d574be None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.574969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c54625-9867-4a5d-baed-e497f0d574be None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.579136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c54625-9867-4a5d-baed-e497f0d574be None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.579136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 49/92] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.579136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c54625-9867-4a5d-baed-e497f0d574be None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.581620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d857900-b337-4acd-87f9-9df01e33b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.582682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d857900-b337-4acd-87f9-9df01e33b551 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.583291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d857900-b337-4acd-87f9-9df01e33b551 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.583831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d857900-b337-4acd-87f9-9df01e33b551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.670564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.676919 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.687532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d857900-b337-4acd-87f9-9df01e33b551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.689696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d857900-b337-4acd-87f9-9df01e33b551 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.697390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c54625-9867-4a5d-baed-e497f0d574be None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.740641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46b87-83ce-45d4-8617-a3e2dd4dc5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.741685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46b87-83ce-45d4-8617-a3e2dd4dc5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.742196 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46b87-83ce-45d4-8617-a3e2dd4dc5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.742717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46b87-83ce-45d4-8617-a3e2dd4dc5c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.743863 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46b87-83ce-45d4-8617-a3e2dd4dc5c3 None admin] RBAC: Adding query filter params (role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=f5484221369c40e6a5c6a9c6c372cd84, user.id=ad64baa998df4ef985f8ebf3cab5798b) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:34.744386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46b87-83ce-45d4-8617-a3e2dd4dc5c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.746030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46b87-83ce-45d4-8617-a3e2dd4dc5c3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.752542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 50/93] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/role_assignments?user.id=ad64baa998df4ef985f8ebf3cab5798b&scope.project.id=f5484221369c40e6a5c6a9c6c372cd84&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.753631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46b87-83ce-45d4-8617-a3e2dd4dc5c3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.831079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 44/94] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:34.831079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d857900-b337-4acd-87f9-9df01e33b551 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.965826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46b87-83ce-45d4-8617-a3e2dd4dc5c3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:35.047294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:35.049658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d53cc9-ad92-45ad-a512-93bb7dc9c574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:35.052385 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d53cc9-ad92-45ad-a512-93bb7dc9c574 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:35.052385 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d53cc9-ad92-45ad-a512-93bb7dc9c574 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:35.052385 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d53cc9-ad92-45ad-a512-93bb7dc9c574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:35.053932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d53cc9-ad92-45ad-a512-93bb7dc9c574 None admin] RBAC: Adding query filter params (role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=372aa814f19d46d68ffb05087f0d23f8, user.id=ad64baa998df4ef985f8ebf3cab5798b) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:35.054253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d53cc9-ad92-45ad-a512-93bb7dc9c574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:35.059157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d53cc9-ad92-45ad-a512-93bb7dc9c574 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:35.062873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 51/95] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/role_assignments?user.id=ad64baa998df4ef985f8ebf3cab5798b&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:35.077475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d857900-b337-4acd-87f9-9df01e33b551 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:35.137938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc19b-d60a-4acb-8b21-7ea86307ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:35.138749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc19b-d60a-4acb-8b21-7ea86307ce3b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:35.139032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc19b-d60a-4acb-8b21-7ea86307ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:35.139338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc19b-d60a-4acb-8b21-7ea86307ce3b None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:35.143981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dc19b-d60a-4acb-8b21-7ea86307ce3b None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:35.145472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dc19b-d60a-4acb-8b21-7ea86307ce3b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:35.147852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 45/96] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:35.153968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d53cc9-ad92-45ad-a512-93bb7dc9c574 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:35.158429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:35.308294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d53cc9-ad92-45ad-a512-93bb7dc9c574 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:35.354420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d250-0b4b-49b1-b8f8-0ff4befc53e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:35.355116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d250-0b4b-49b1-b8f8-0ff4befc53e0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:35.355399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d250-0b4b-49b1-b8f8-0ff4befc53e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:35.355734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d250-0b4b-49b1-b8f8-0ff4befc53e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:35.356587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d250-0b4b-49b1-b8f8-0ff4befc53e0 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=372aa814f19d46d68ffb05087f0d23f8, user.id=8ee8c41befe5418c95bad9a434d99f95) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:35.356902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d250-0b4b-49b1-b8f8-0ff4befc53e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:35.358365 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d250-0b4b-49b1-b8f8-0ff4befc53e0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:35.364570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 52/97] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:35 2022] GET /identity/v3/role_assignments?user.id=8ee8c41befe5418c95bad9a434d99f95&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:37.340357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf04184-6057-4590-bc4b-d12c2af34cf3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.341300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf04184-6057-4590-bc4b-d12c2af34cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.341779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf04184-6057-4590-bc4b-d12c2af34cf3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.343412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 46/98] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:37.348687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edfaf9-d8e1-4bec-a2e2-86b8ff289654 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.349157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edfaf9-d8e1-4bec-a2e2-86b8ff289654 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.349444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edfaf9-d8e1-4bec-a2e2-86b8ff289654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.372073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-30edfaf9-d8e1-4bec-a2e2-86b8ff289654 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:37.373286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-30edfaf9-d8e1-4bec-a2e2-86b8ff289654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:37.447323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.456859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 53/99] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:37.463730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdaf1c-679d-4b43-9168-be21d123254a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.464239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdaf1c-679d-4b43-9168-be21d123254a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.464707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdaf1c-679d-4b43-9168-be21d123254a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.466284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 47/100] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:37.471749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b05430-65b9-4aae-9afb-912a1edc5989 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.483175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b05430-65b9-4aae-9afb-912a1edc5989 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.483175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b05430-65b9-4aae-9afb-912a1edc5989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.496089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b0b05430-65b9-4aae-9afb-912a1edc5989 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:37.497280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b0b05430-65b9-4aae-9afb-912a1edc5989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:37.515060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdaf1c-679d-4b43-9168-be21d123254a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.599201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 54/101] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:37.600947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a86c69-8158-48f8-9456-9f0ae8d85ccc None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.601436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a86c69-8158-48f8-9456-9f0ae8d85ccc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.601927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a86c69-8158-48f8-9456-9f0ae8d85ccc None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.603802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 55/102] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:37.623827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61daba9-6187-4bba-964d-01d5f1003755 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.624469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61daba9-6187-4bba-964d-01d5f1003755 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.624940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61daba9-6187-4bba-964d-01d5f1003755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.655272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f61daba9-6187-4bba-964d-01d5f1003755 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:37.656830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f61daba9-6187-4bba-964d-01d5f1003755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:37.686098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdaf1c-679d-4b43-9168-be21d123254a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:37.722481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba779a4f-6f3f-4986-9c37-24af73ef6949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:37.723327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba779a4f-6f3f-4986-9c37-24af73ef6949 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.723672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba779a4f-6f3f-4986-9c37-24af73ef6949 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.723930 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba779a4f-6f3f-4986-9c37-24af73ef6949 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.735854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba779a4f-6f3f-4986-9c37-24af73ef6949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ba779a4f-6f3f-4986-9c37-24af73ef6949 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:37.746578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:37.747551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 48/103] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:37.748295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba779a4f-6f3f-4986-9c37-24af73ef6949 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.799459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.801257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 56/104] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:37.802580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61daba9-6187-4bba-964d-01d5f1003755 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.901952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.999928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61daba9-6187-4bba-964d-01d5f1003755 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.007884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba779a4f-6f3f-4986-9c37-24af73ef6949 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.045774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d79ccb-b7cf-4463-a78c-b3145271b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.046586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d79ccb-b7cf-4463-a78c-b3145271b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.046872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d79ccb-b7cf-4463-a78c-b3145271b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.047169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d79ccb-b7cf-4463-a78c-b3145271b7a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.048284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c06c3-504e-4f26-8d00-72462bfcb572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.049063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c06c3-504e-4f26-8d00-72462bfcb572 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.049346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c06c3-504e-4f26-8d00-72462bfcb572 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.049619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c06c3-504e-4f26-8d00-72462bfcb572 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.050372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c06c3-504e-4f26-8d00-72462bfcb572 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:38.050679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c06c3-504e-4f26-8d00-72462bfcb572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.053005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c06c3-504e-4f26-8d00-72462bfcb572 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.070197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d79ccb-b7cf-4463-a78c-b3145271b7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-37d79ccb-b7cf-4463-a78c-b3145271b7a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:38.078182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:38.079138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:38.079900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:38.081558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 57/105] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.082224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c06c3-504e-4f26-8d00-72462bfcb572 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.087245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 49/106] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:38.092620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d79ccb-b7cf-4463-a78c-b3145271b7a7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.197751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.217478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d79ccb-b7cf-4463-a78c-b3145271b7a7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.222307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c06c3-504e-4f26-8d00-72462bfcb572 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.252579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.267656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5520-7e56-4291-b117-95ae073b3d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.268668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7298db6-7eba-4311-acb7-0b9056ebaf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.269043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5520-7e56-4291-b117-95ae073b3d23 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.269142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5520-7e56-4291-b117-95ae073b3d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.269529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5520-7e56-4291-b117-95ae073b3d23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.270472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7298db6-7eba-4311-acb7-0b9056ebaf23 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.271459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7298db6-7eba-4311-acb7-0b9056ebaf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.271579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5520-7e56-4291-b117-95ae073b3d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.271969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7298db6-7eba-4311-acb7-0b9056ebaf23 None admin] PATH_INFO: `/v3/users/ddb815e590084a93adff696fedc4b993` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.273427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5520-7e56-4291-b117-95ae073b3d23 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.276011 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 58/107] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.276315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5520-7e56-4291-b117-95ae073b3d23 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.289597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7298db6-7eba-4311-acb7-0b9056ebaf23 None admin] RBAC: Authorizing `identity:get_user(user_id=ddb815e590084a93adff696fedc4b993)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.292014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7298db6-7eba-4311-acb7-0b9056ebaf23 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.294434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 50/108] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/users/ddb815e590084a93adff696fedc4b993 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.296341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000652-4825-4f6e-97f2-df46fb91d23e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.296870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000652-4825-4f6e-97f2-df46fb91d23e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.297303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000652-4825-4f6e-97f2-df46fb91d23e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.303260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 51/109] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:38.305053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53000652-4825-4f6e-97f2-df46fb91d23e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.400618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5520-7e56-4291-b117-95ae073b3d23 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.422320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53000652-4825-4f6e-97f2-df46fb91d23e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.439778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7da9-3d54-4760-b93c-2f7493ecc0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.440447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7da9-3d54-4760-b93c-2f7493ecc0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.440729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7da9-3d54-4760-b93c-2f7493ecc0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.441000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7da9-3d54-4760-b93c-2f7493ecc0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.441746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7da9-3d54-4760-b93c-2f7493ecc0d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:38.442078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7da9-3d54-4760-b93c-2f7493ecc0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.443513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7da9-3d54-4760-b93c-2f7493ecc0d0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.451773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 59/110] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.452504 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7da9-3d54-4760-b93c-2f7493ecc0d0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.458593 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d1bb1-aba0-4282-ae28-1d88c8d95e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.459370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d1bb1-aba0-4282-ae28-1d88c8d95e3c None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.459656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d1bb1-aba0-4282-ae28-1d88c8d95e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.459930 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d1bb1-aba0-4282-ae28-1d88c8d95e3c None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.460692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d1bb1-aba0-4282-ae28-1d88c8d95e3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.462336 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d1bb1-aba0-4282-ae28-1d88c8d95e3c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.475741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.507658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.549696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 52/111] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:53:38 2022] POST /identity/v3/projects => generated 302 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:38.549696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fed4-2542-48d6-86b8-aab8a2a65f97 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.549696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fed4-2542-48d6-86b8-aab8a2a65f97 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.549696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fed4-2542-48d6-86b8-aab8a2a65f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.568640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-26a6fed4-2542-48d6-86b8-aab8a2a65f97 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:38.570777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-26a6fed4-2542-48d6-86b8-aab8a2a65f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:38.572763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7da9-3d54-4760-b93c-2f7493ecc0d0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.614017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13d73f-ab26-4301-99ad-993eb8b3a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.615062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13d73f-ab26-4301-99ad-993eb8b3a3ca None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.615466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13d73f-ab26-4301-99ad-993eb8b3a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.615815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13d73f-ab26-4301-99ad-993eb8b3a3ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.663770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 53/112] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:38.665266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323832-9995-453f-b04f-4c6213ffad1e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.665561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323832-9995-453f-b04f-4c6213ffad1e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.665834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323832-9995-453f-b04f-4c6213ffad1e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.667517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 54/113] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:38.668043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b323832-9995-453f-b04f-4c6213ffad1e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.718332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13d73f-ab26-4301-99ad-993eb8b3a3ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.719867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13d73f-ab26-4301-99ad-993eb8b3a3ca None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.776930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.801743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b323832-9995-453f-b04f-4c6213ffad1e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.837223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.851139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 60/114] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:38.852695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09abbbe-8f7b-4ed3-8d53-6b90ee229cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.852819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f338b7-b665-4a88-8207-65f777441ec3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.853125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f338b7-b665-4a88-8207-65f777441ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.853451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f338b7-b665-4a88-8207-65f777441ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.854329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abbbe-8f7b-4ed3-8d53-6b90ee229cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.854815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abbbe-8f7b-4ed3-8d53-6b90ee229cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.855357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abbbe-8f7b-4ed3-8d53-6b90ee229cd0 None admin] PATH_INFO: `/v3/users/ad64baa998df4ef985f8ebf3cab5798b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.856945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09abbbe-8f7b-4ed3-8d53-6b90ee229cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=ad64baa998df4ef985f8ebf3cab5798b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.858621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09abbbe-8f7b-4ed3-8d53-6b90ee229cd0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.860455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 55/115] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/users/ad64baa998df4ef985f8ebf3cab5798b => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.865538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09abbbe-8f7b-4ed3-8d53-6b90ee229cd0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.871905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d9f338b7-b665-4a88-8207-65f777441ec3 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:38.876603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d9f338b7-b665-4a88-8207-65f777441ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:38.944078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 61/116] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:38.944774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f338b7-b665-4a88-8207-65f777441ec3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.984146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09abbbe-8f7b-4ed3-8d53-6b90ee229cd0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.020043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0bd18-5c04-437d-b476-e07718c6e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.020886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0bd18-5c04-437d-b476-e07718c6e346 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.021175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0bd18-5c04-437d-b476-e07718c6e346 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.021456 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0bd18-5c04-437d-b476-e07718c6e346 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.032974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0bd18-5c04-437d-b476-e07718c6e346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:39.036619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-96b0bd18-5c04-437d-b476-e07718c6e346 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:39.041419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:39.042448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 56/117] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:39.048542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0bd18-5c04-437d-b476-e07718c6e346 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.059568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f338b7-b665-4a88-8207-65f777441ec3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.097876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:39.099470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d7c80-5f0b-4dc1-af71-a602fabd174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.100339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7c80-5f0b-4dc1-af71-a602fabd174f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.100619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7c80-5f0b-4dc1-af71-a602fabd174f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.100894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7c80-5f0b-4dc1-af71-a602fabd174f None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.102314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d7c80-5f0b-4dc1-af71-a602fabd174f None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:39.103863 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d7c80-5f0b-4dc1-af71-a602fabd174f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:39.105607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 62/118] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:39.106779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c5971-e894-46af-bf5c-dcabd8a2f5b9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.107062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c5971-e894-46af-bf5c-dcabd8a2f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.107358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c5971-e894-46af-bf5c-dcabd8a2f5b9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.112580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 63/119] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:39.112580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c5971-e894-46af-bf5c-dcabd8a2f5b9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.158617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0bd18-5c04-437d-b476-e07718c6e346 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.194724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c601b48-190f-47b3-ae67-b60848a11a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.195623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601b48-190f-47b3-ae67-b60848a11a45 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.195908 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601b48-190f-47b3-ae67-b60848a11a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.196186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601b48-190f-47b3-ae67-b60848a11a45 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.197384 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601b48-190f-47b3-ae67-b60848a11a45 None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:39.198832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601b48-190f-47b3-ae67-b60848a11a45 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:39.200633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 57/120] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:39 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:39.201451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c601b48-190f-47b3-ae67-b60848a11a45 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.226799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c5971-e894-46af-bf5c-dcabd8a2f5b9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.270150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc88f0-d984-4e0f-90ce-e936f8f299db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.270987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc88f0-d984-4e0f-90ce-e936f8f299db None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.271296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc88f0-d984-4e0f-90ce-e936f8f299db None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.271571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc88f0-d984-4e0f-90ce-e936f8f299db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.282007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc88f0-d984-4e0f-90ce-e936f8f299db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b1dc88f0-d984-4e0f-90ce-e936f8f299db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:39.290010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:39.290845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:39.291650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 64/121] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:39.292282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc88f0-d984-4e0f-90ce-e936f8f299db None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.304242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:39.321107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c601b48-190f-47b3-ae67-b60848a11a45 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.338100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:39.354871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b4eed-9b53-42a5-8be6-4693dbdf9432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.355573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b4eed-9b53-42a5-8be6-4693dbdf9432 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.355857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b4eed-9b53-42a5-8be6-4693dbdf9432 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.356128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b4eed-9b53-42a5-8be6-4693dbdf9432 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.356967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b4eed-9b53-42a5-8be6-4693dbdf9432 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:39.357523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b4eed-9b53-42a5-8be6-4693dbdf9432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:39.358650 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b4eed-9b53-42a5-8be6-4693dbdf9432 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:39.372093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 58/122] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:39.372093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e1de7-b5d4-4a30-9a56-2264796beeef None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.372093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e1de7-b5d4-4a30-9a56-2264796beeef None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.372093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e1de7-b5d4-4a30-9a56-2264796beeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.387768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0e9e1de7-b5d4-4a30-9a56-2264796beeef None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:39.388955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0e9e1de7-b5d4-4a30-9a56-2264796beeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:39.407659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc88f0-d984-4e0f-90ce-e936f8f299db None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.443141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d239-d6db-49b1-8b13-f9b32d644351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.443810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d239-d6db-49b1-8b13-f9b32d644351 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.444091 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d239-d6db-49b1-8b13-f9b32d644351 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.444370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d239-d6db-49b1-8b13-f9b32d644351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.445205 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d239-d6db-49b1-8b13-f9b32d644351 None admin] RBAC: Adding query filter params (role.id=61c5b1b2390148b883b9a95a739b6736, scope.project.id=372aa814f19d46d68ffb05087f0d23f8, user.id=ddb815e590084a93adff696fedc4b993) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:39.445526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d239-d6db-49b1-8b13-f9b32d644351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:39.446987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d239-d6db-49b1-8b13-f9b32d644351 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:39.452467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 65/123] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:39 2022] GET /identity/v3/role_assignments?user.id=ddb815e590084a93adff696fedc4b993&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=61c5b1b2390148b883b9a95a739b6736 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:39.453244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d239-d6db-49b1-8b13-f9b32d644351 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.470667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 59/124] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:39.472352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e1de7-b5d4-4a30-9a56-2264796beeef None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.552794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:39.589609 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e1de7-b5d4-4a30-9a56-2264796beeef None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.594432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d239-d6db-49b1-8b13-f9b32d644351 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.605234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:39.638306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96e6ad-aec9-426b-88cb-b7d50e2e34f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.638841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb80d8c-3fa2-447a-a06e-e0078d2d8a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.639267 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e6ad-aec9-426b-88cb-b7d50e2e34f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.639553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e6ad-aec9-426b-88cb-b7d50e2e34f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.639832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e6ad-aec9-426b-88cb-b7d50e2e34f7 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8/users/ad64baa998df4ef985f8ebf3cab5798b/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.640180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb80d8c-3fa2-447a-a06e-e0078d2d8a97 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.640617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb80d8c-3fa2-447a-a06e-e0078d2d8a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.640892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb80d8c-3fa2-447a-a06e-e0078d2d8a97 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.641928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb80d8c-3fa2-447a-a06e-e0078d2d8a97 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:39.642241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb80d8c-3fa2-447a-a06e-e0078d2d8a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:39.642432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96e6ad-aec9-426b-88cb-b7d50e2e34f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=372aa814f19d46d68ffb05087f0d23f8, user_id=ad64baa998df4ef985f8ebf3cab5798b, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:39.643659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb80d8c-3fa2-447a-a06e-e0078d2d8a97 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:39.644310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96e6ad-aec9-426b-88cb-b7d50e2e34f7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:39.663134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 60/125] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:39.663134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb80d8c-3fa2-447a-a06e-e0078d2d8a97 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.735542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 66/126] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:39 2022] PUT /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8/users/ad64baa998df4ef985f8ebf3cab5798b/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:39.745208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96e6ad-aec9-426b-88cb-b7d50e2e34f7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.811366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb80d8c-3fa2-447a-a06e-e0078d2d8a97 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.890537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7766d2-2c35-4cd6-8d48-44f773983b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.891467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7766d2-2c35-4cd6-8d48-44f773983b0e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.891744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7766d2-2c35-4cd6-8d48-44f773983b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.892013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7766d2-2c35-4cd6-8d48-44f773983b0e None admin] PATH_INFO: `/v3/users/ad64baa998df4ef985f8ebf3cab5798b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.893394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7766d2-2c35-4cd6-8d48-44f773983b0e None admin] RBAC: Authorizing `identity:get_user(user_id=ad64baa998df4ef985f8ebf3cab5798b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:39.894965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7766d2-2c35-4cd6-8d48-44f773983b0e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:39.898994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 61/127] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:39 2022] GET /identity/v3/users/ad64baa998df4ef985f8ebf3cab5798b => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:39.899937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7766d2-2c35-4cd6-8d48-44f773983b0e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.948982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96e6ad-aec9-426b-88cb-b7d50e2e34f7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.976199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.023824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.031357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2973-c114-43db-b178-b576bc633f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.032403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2973-c114-43db-b178-b576bc633f9b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.032757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2973-c114-43db-b178-b576bc633f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.033038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2973-c114-43db-b178-b576bc633f9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.045966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b2973-c114-43db-b178-b576bc633f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:40.051123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7766d2-2c35-4cd6-8d48-44f773983b0e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f78b2973-c114-43db-b178-b576bc633f9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:40.053766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:40.054813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:40.055737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 67/128] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:40.056397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2973-c114-43db-b178-b576bc633f9b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.100450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab32b5-7328-4e58-9691-ad795d85c316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.102029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab32b5-7328-4e58-9691-ad795d85c316 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.102383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab32b5-7328-4e58-9691-ad795d85c316 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.102729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab32b5-7328-4e58-9691-ad795d85c316 None admin] PATH_INFO: `/v3/users/ad64baa998df4ef985f8ebf3cab5798b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.104305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab32b5-7328-4e58-9691-ad795d85c316 None admin] RBAC: Authorizing `identity:get_user(user_id=ad64baa998df4ef985f8ebf3cab5798b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.106469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab32b5-7328-4e58-9691-ad795d85c316 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.108836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 62/129] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:39 2022] GET /identity/v3/users/ad64baa998df4ef985f8ebf3cab5798b => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:40.110506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab32b5-7328-4e58-9691-ad795d85c316 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.169367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2973-c114-43db-b178-b576bc633f9b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.225593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f67370-bbef-4234-8098-2f88db1e328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.226465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67370-bbef-4234-8098-2f88db1e328d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.226999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67370-bbef-4234-8098-2f88db1e328d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.227312 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67370-bbef-4234-8098-2f88db1e328d None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.229130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f67370-bbef-4234-8098-2f88db1e328d None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.230594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f67370-bbef-4234-8098-2f88db1e328d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.232485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 68/130] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:40.233087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f67370-bbef-4234-8098-2f88db1e328d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.266296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab32b5-7328-4e58-9691-ad795d85c316 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.285644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.335770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895511f3-e79a-44fb-96ce-714df9394962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.336450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895511f3-e79a-44fb-96ce-714df9394962 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.336736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895511f3-e79a-44fb-96ce-714df9394962 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.337014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895511f3-e79a-44fb-96ce-714df9394962 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.337771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895511f3-e79a-44fb-96ce-714df9394962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:40.338086 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895511f3-e79a-44fb-96ce-714df9394962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.339495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895511f3-e79a-44fb-96ce-714df9394962 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.348585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.355498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 63/131] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:40.356271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895511f3-e79a-44fb-96ce-714df9394962 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.420416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f67370-bbef-4234-8098-2f88db1e328d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.482664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe030b2d-0e79-462c-906f-361be65eb4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.483570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe030b2d-0e79-462c-906f-361be65eb4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.483858 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe030b2d-0e79-462c-906f-361be65eb4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.484136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe030b2d-0e79-462c-906f-361be65eb4d1 None admin] PATH_INFO: `/v3/projects/f5484221369c40e6a5c6a9c6c372cd84` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.487896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe030b2d-0e79-462c-906f-361be65eb4d1 None admin] RBAC: Authorizing `identity:get_project(project_id=f5484221369c40e6a5c6a9c6c372cd84)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.489958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe030b2d-0e79-462c-906f-361be65eb4d1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.491771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 69/132] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/projects/f5484221369c40e6a5c6a9c6c372cd84 => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:40.492550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe030b2d-0e79-462c-906f-361be65eb4d1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.516555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895511f3-e79a-44fb-96ce-714df9394962 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.582519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8daf85-c835-4196-9ef4-7e2085fffea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.583887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8daf85-c835-4196-9ef4-7e2085fffea5 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.584387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8daf85-c835-4196-9ef4-7e2085fffea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.584871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8daf85-c835-4196-9ef4-7e2085fffea5 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8/users/ad64baa998df4ef985f8ebf3cab5798b/roles/cd5bf20507a2408d8f752cc0be80f77f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.588738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8daf85-c835-4196-9ef4-7e2085fffea5 None admin] RBAC: Authorizing `identity:create_grant(project_id=372aa814f19d46d68ffb05087f0d23f8, user_id=ad64baa998df4ef985f8ebf3cab5798b, role_id=cd5bf20507a2408d8f752cc0be80f77f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.590649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8daf85-c835-4196-9ef4-7e2085fffea5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.617338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe030b2d-0e79-462c-906f-361be65eb4d1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.645774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.654706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bafa53-55cb-4c64-9288-a8382c00b018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.655912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bafa53-55cb-4c64-9288-a8382c00b018 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.656464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bafa53-55cb-4c64-9288-a8382c00b018 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.656966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bafa53-55cb-4c64-9288-a8382c00b018 None admin] PATH_INFO: `/v3/users/8ee8c41befe5418c95bad9a434d99f95` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.658436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bafa53-55cb-4c64-9288-a8382c00b018 None admin] RBAC: Authorizing `identity:get_user(user_id=8ee8c41befe5418c95bad9a434d99f95)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.660273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bafa53-55cb-4c64-9288-a8382c00b018 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.662207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 70/133] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/users/8ee8c41befe5418c95bad9a434d99f95 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:40.663178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bafa53-55cb-4c64-9288-a8382c00b018 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.701492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 64/134] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:40 2022] PUT /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8/users/ad64baa998df4ef985f8ebf3cab5798b/roles/cd5bf20507a2408d8f752cc0be80f77f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:40.702786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8daf85-c835-4196-9ef4-7e2085fffea5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.768053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.855884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bafa53-55cb-4c64-9288-a8382c00b018 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.924477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8daf85-c835-4196-9ef4-7e2085fffea5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.943688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc1e4f-15ce-47b9-9cb3-88aa8fc7aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.944974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc1e4f-15ce-47b9-9cb3-88aa8fc7aff3 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.945466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc1e4f-15ce-47b9-9cb3-88aa8fc7aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.945946 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc1e4f-15ce-47b9-9cb3-88aa8fc7aff3 None admin] PATH_INFO: `/v3/projects/f5484221369c40e6a5c6a9c6c372cd84/users/ad64baa998df4ef985f8ebf3cab5798b/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.950832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc1e4f-15ce-47b9-9cb3-88aa8fc7aff3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5484221369c40e6a5c6a9c6c372cd84, user_id=ad64baa998df4ef985f8ebf3cab5798b, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.952838 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc1e4f-15ce-47b9-9cb3-88aa8fc7aff3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.985322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12520ea7-c4c0-4480-94db-d008d3d65605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.986216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12520ea7-c4c0-4480-94db-d008d3d65605 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.986490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12520ea7-c4c0-4480-94db-d008d3d65605 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.986766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12520ea7-c4c0-4480-94db-d008d3d65605 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.987991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12520ea7-c4c0-4480-94db-d008d3d65605 None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.990112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12520ea7-c4c0-4480-94db-d008d3d65605 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.992314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 65/135] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:40.997683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12520ea7-c4c0-4480-94db-d008d3d65605 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:41.038813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 71/136] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:40 2022] PUT /identity/v3/projects/f5484221369c40e6a5c6a9c6c372cd84/users/ad64baa998df4ef985f8ebf3cab5798b/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:41.129495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:41.134121 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12520ea7-c4c0-4480-94db-d008d3d65605 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:41.180295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac4848-a832-4a30-8c66-dac0b720263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:41.181223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac4848-a832-4a30-8c66-dac0b720263b None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.181515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac4848-a832-4a30-8c66-dac0b720263b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.181876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac4848-a832-4a30-8c66-dac0b720263b None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8/users/8ee8c41befe5418c95bad9a434d99f95/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.184967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac4848-a832-4a30-8c66-dac0b720263b None admin] RBAC: Authorizing `identity:create_grant(project_id=372aa814f19d46d68ffb05087f0d23f8, user_id=8ee8c41befe5418c95bad9a434d99f95, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:41.186408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac4848-a832-4a30-8c66-dac0b720263b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:41.210815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3063b91-d5a3-47e9-a04f-5fa1a4d98db1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.211496 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3063b91-d5a3-47e9-a04f-5fa1a4d98db1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.211997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3063b91-d5a3-47e9-a04f-5fa1a4d98db1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.213779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 72/137] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:41.219536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2a3f-836e-42cc-b185-c825c7d60c0e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.220089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2a3f-836e-42cc-b185-c825c7d60c0e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.220574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2a3f-836e-42cc-b185-c825c7d60c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.247904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c13f2a3f-836e-42cc-b185-c825c7d60c0e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:41.255261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c13f2a3f-836e-42cc-b185-c825c7d60c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:41.281414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 66/138] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:40 2022] PUT /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8/users/8ee8c41befe5418c95bad9a434d99f95/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:53:41.352330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:41.370341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 73/139] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:41.409884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac4848-a832-4a30-8c66-dac0b720263b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:41.536865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac4848-a832-4a30-8c66-dac0b720263b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:41.576885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20618593-57c0-4d0d-b160-20db0fbf8cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:41.577695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618593-57c0-4d0d-b160-20db0fbf8cda None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.577980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618593-57c0-4d0d-b160-20db0fbf8cda None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.578256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618593-57c0-4d0d-b160-20db0fbf8cda None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.579519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20618593-57c0-4d0d-b160-20db0fbf8cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:41.580981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20618593-57c0-4d0d-b160-20db0fbf8cda None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:41.583087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 67/140] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:41.589792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f2a3f-836e-42cc-b185-c825c7d60c0e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:41.736103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f2a3f-836e-42cc-b185-c825c7d60c0e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:41.783561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74457df0-3e5a-4a94-ac47-192aa432550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:41.784250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457df0-3e5a-4a94-ac47-192aa432550b None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.784532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457df0-3e5a-4a94-ac47-192aa432550b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.784809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457df0-3e5a-4a94-ac47-192aa432550b None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.785546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74457df0-3e5a-4a94-ac47-192aa432550b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:41.787683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74457df0-3e5a-4a94-ac47-192aa432550b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:41.907072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 74/141] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:41 2022] POST /identity/v3/users => generated 283 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:53:42.205429 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2eb7-b7ca-4fbd-83f9-60f6ea891403 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.205770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2eb7-b7ca-4fbd-83f9-60f6ea891403 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.205953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2eb7-b7ca-4fbd-83f9-60f6ea891403 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.207406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 68/142] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:42.221006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8892af7-0f1e-4a81-8dc0-d24369d439e0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.221319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8892af7-0f1e-4a81-8dc0-d24369d439e0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.221566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8892af7-0f1e-4a81-8dc0-d24369d439e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.247209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d8892af7-0f1e-4a81-8dc0-d24369d439e0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:42.248426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d8892af7-0f1e-4a81-8dc0-d24369d439e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:42.305303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:42.346903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 75/143] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:42.371760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f2eb7-b7ca-4fbd-83f9-60f6ea891403 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.407173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:42.505167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f2eb7-b7ca-4fbd-83f9-60f6ea891403 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.559033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e11da-324a-4cc2-add6-905c1312b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.559937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e11da-324a-4cc2-add6-905c1312b68d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.560231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e11da-324a-4cc2-add6-905c1312b68d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.560509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e11da-324a-4cc2-add6-905c1312b68d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.575745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e11da-324a-4cc2-add6-905c1312b68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-040e11da-324a-4cc2-add6-905c1312b68d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:42.584273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:42.585142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:42.585909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 69/144] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:42.592977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8892af7-0f1e-4a81-8dc0-d24369d439e0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.718880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8892af7-0f1e-4a81-8dc0-d24369d439e0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.761582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf688bc0-aa80-4246-9787-1abef813fb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.762187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf688bc0-aa80-4246-9787-1abef813fb00 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.762471 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf688bc0-aa80-4246-9787-1abef813fb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.762804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf688bc0-aa80-4246-9787-1abef813fb00 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.763600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf688bc0-aa80-4246-9787-1abef813fb00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:42.763911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf688bc0-aa80-4246-9787-1abef813fb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:42.765322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf688bc0-aa80-4246-9787-1abef813fb00 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:42.777697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 76/145] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:42.783640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e11da-324a-4cc2-add6-905c1312b68d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.890599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:42.907700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e11da-324a-4cc2-add6-905c1312b68d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.947504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f41d2-02fc-4185-a025-374ffffa1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.948403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f41d2-02fc-4185-a025-374ffffa1810 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.948693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f41d2-02fc-4185-a025-374ffffa1810 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.948974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f41d2-02fc-4185-a025-374ffffa1810 None admin] PATH_INFO: `/v3/users/ddb815e590084a93adff696fedc4b993` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.950229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f41d2-02fc-4185-a025-374ffffa1810 None admin] RBAC: Authorizing `identity:get_user(user_id=ddb815e590084a93adff696fedc4b993)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:42.951710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f41d2-02fc-4185-a025-374ffffa1810 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:42.953362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 70/146] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/users/ddb815e590084a93adff696fedc4b993 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:42.959016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf688bc0-aa80-4246-9787-1abef813fb00 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:43.001557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:43.072186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf688bc0-aa80-4246-9787-1abef813fb00 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.110996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cd7b7-9c4f-4ea0-b2ae-55a2b2376474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.111894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cd7b7-9c4f-4ea0-b2ae-55a2b2376474 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.112177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cd7b7-9c4f-4ea0-b2ae-55a2b2376474 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.112454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cd7b7-9c4f-4ea0-b2ae-55a2b2376474 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.113661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cd7b7-9c4f-4ea0-b2ae-55a2b2376474 None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:43.115749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cd7b7-9c4f-4ea0-b2ae-55a2b2376474 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:43.117520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 77/147] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:43.123390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f41d2-02fc-4185-a025-374ffffa1810 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:43.228664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f41d2-02fc-4185-a025-374ffffa1810 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.263643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e1b66-100d-454e-9ea8-cbd327976488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.264551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e1b66-100d-454e-9ea8-cbd327976488 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.264835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e1b66-100d-454e-9ea8-cbd327976488 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.265113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e1b66-100d-454e-9ea8-cbd327976488 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8/users/ddb815e590084a93adff696fedc4b993/roles/61c5b1b2390148b883b9a95a739b6736` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.267252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e1b66-100d-454e-9ea8-cbd327976488 None admin] RBAC: Authorizing `identity:create_grant(project_id=372aa814f19d46d68ffb05087f0d23f8, user_id=ddb815e590084a93adff696fedc4b993, role_id=61c5b1b2390148b883b9a95a739b6736)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:43.268797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e1b66-100d-454e-9ea8-cbd327976488 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:43.283185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767c51-dcd2-4862-97f7-2a527365c1fb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.283480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767c51-dcd2-4862-97f7-2a527365c1fb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.288095 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767c51-dcd2-4862-97f7-2a527365c1fb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.288095 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 78/148] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:43.291414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb3769-50ad-4228-b8bf-881ecc26c385 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.291713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb3769-50ad-4228-b8bf-881ecc26c385 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.291989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb3769-50ad-4228-b8bf-881ecc26c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.310459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-efbb3769-50ad-4228-b8bf-881ecc26c385 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:43.311686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-efbb3769-50ad-4228-b8bf-881ecc26c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:43.346485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 71/149] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:43 2022] PUT /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8/users/ddb815e590084a93adff696fedc4b993/roles/61c5b1b2390148b883b9a95a739b6736 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:43.418241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 79/150] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:43.447883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e1b66-100d-454e-9ea8-cbd327976488 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:43.466745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:43.568478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e1b66-100d-454e-9ea8-cbd327976488 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.606686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67c8bd-b95f-43a4-99dc-6d2d7705a7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.607492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67c8bd-b95f-43a4-99dc-6d2d7705a7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.607782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67c8bd-b95f-43a4-99dc-6d2d7705a7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.608062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67c8bd-b95f-43a4-99dc-6d2d7705a7d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.624529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67c8bd-b95f-43a4-99dc-6d2d7705a7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-4d67c8bd-b95f-43a4-99dc-6d2d7705a7d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:43.632513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:43.633414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:43.634163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 72/151] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:43.641187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb3769-50ad-4228-b8bf-881ecc26c385 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:43.682823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:43.763487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb3769-50ad-4228-b8bf-881ecc26c385 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.800692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0caf8d-8883-4549-a309-deae9bb986de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.801412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0caf8d-8883-4549-a309-deae9bb986de None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.801695 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0caf8d-8883-4549-a309-deae9bb986de None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.801967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0caf8d-8883-4549-a309-deae9bb986de None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.802724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0caf8d-8883-4549-a309-deae9bb986de None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:43.803030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0caf8d-8883-4549-a309-deae9bb986de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:43.804445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0caf8d-8883-4549-a309-deae9bb986de None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:43.813998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 80/152] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:43.820234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67c8bd-b95f-43a4-99dc-6d2d7705a7d6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:43.903283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:43.928857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67c8bd-b95f-43a4-99dc-6d2d7705a7d6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.965394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7849d8-a16b-4695-8777-15f41aee27e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.966282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7849d8-a16b-4695-8777-15f41aee27e0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.966566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7849d8-a16b-4695-8777-15f41aee27e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.966844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7849d8-a16b-4695-8777-15f41aee27e0 None admin] PATH_INFO: `/v3/users/ad64baa998df4ef985f8ebf3cab5798b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.968097 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7849d8-a16b-4695-8777-15f41aee27e0 None admin] RBAC: Authorizing `identity:get_user(user_id=ad64baa998df4ef985f8ebf3cab5798b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:43.969564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7849d8-a16b-4695-8777-15f41aee27e0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:43.971605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 73/153] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:43 2022] GET /identity/v3/users/ad64baa998df4ef985f8ebf3cab5798b => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:43.977446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0caf8d-8883-4549-a309-deae9bb986de None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:44.086688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:44.098808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0caf8d-8883-4549-a309-deae9bb986de None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:44.147918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a55e77-671c-46b1-88f0-d8674f38eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:44.148585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a55e77-671c-46b1-88f0-d8674f38eabf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.148870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a55e77-671c-46b1-88f0-d8674f38eabf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.149146 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a55e77-671c-46b1-88f0-d8674f38eabf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.235671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a55e77-671c-46b1-88f0-d8674f38eabf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:44.237458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a55e77-671c-46b1-88f0-d8674f38eabf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:44.334965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:44.343122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 81/154] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:44.348852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7849d8-a16b-4695-8777-15f41aee27e0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:44.410064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef237f-27ba-4df0-86af-858554b6eb8d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.410791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef237f-27ba-4df0-86af-858554b6eb8d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.411322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef237f-27ba-4df0-86af-858554b6eb8d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.413012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 82/155] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:44.428181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a745b63-7a33-4c51-91ca-8a62052e8ebd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.428799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a745b63-7a33-4c51-91ca-8a62052e8ebd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.429275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a745b63-7a33-4c51-91ca-8a62052e8ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.456249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6a745b63-7a33-4c51-91ca-8a62052e8ebd None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:44.457886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6a745b63-7a33-4c51-91ca-8a62052e8ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:44.499014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7849d8-a16b-4695-8777-15f41aee27e0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:44.550723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce969-83db-42c4-bb00-914c5a07092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:44.552582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce969-83db-42c4-bb00-914c5a07092d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.553034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce969-83db-42c4-bb00-914c5a07092d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.553465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce969-83db-42c4-bb00-914c5a07092d None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.558409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 83/156] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:44.563131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ce969-83db-42c4-bb00-914c5a07092d None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:44.563131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ce969-83db-42c4-bb00-914c5a07092d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:44.563378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 74/157] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:44 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:44.569672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a745b63-7a33-4c51-91ca-8a62052e8ebd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:44.594065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce969-83db-42c4-bb00-914c5a07092d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:44.617906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:44.702107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a745b63-7a33-4c51-91ca-8a62052e8ebd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:44.729003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:44.741480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81253c-d63d-4d4e-9f0a-4e9713e1b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:44.742367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81253c-d63d-4d4e-9f0a-4e9713e1b302 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.742790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81253c-d63d-4d4e-9f0a-4e9713e1b302 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.743231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81253c-d63d-4d4e-9f0a-4e9713e1b302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.743392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce969-83db-42c4-bb00-914c5a07092d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:44.744350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81253c-d63d-4d4e-9f0a-4e9713e1b302 None admin] RBAC: Adding query filter params (role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=372aa814f19d46d68ffb05087f0d23f8, user.id=ad64baa998df4ef985f8ebf3cab5798b) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:44.744796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81253c-d63d-4d4e-9f0a-4e9713e1b302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:44.746652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81253c-d63d-4d4e-9f0a-4e9713e1b302 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:44.753241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 84/158] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:44 2022] GET /identity/v3/role_assignments?user.id=ad64baa998df4ef985f8ebf3cab5798b&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:44.790124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f367a6-e979-4d9b-9425-64f7f2f1bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:44.791050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f367a6-e979-4d9b-9425-64f7f2f1bc09 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.791433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f367a6-e979-4d9b-9425-64f7f2f1bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.791780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f367a6-e979-4d9b-9425-64f7f2f1bc09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.811452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f367a6-e979-4d9b-9425-64f7f2f1bc09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e3f367a6-e979-4d9b-9425-64f7f2f1bc09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:44.819953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:44.820884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:44.821670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 75/159] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:44.827278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81253c-d63d-4d4e-9f0a-4e9713e1b302 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:44.960912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81253c-d63d-4d4e-9f0a-4e9713e1b302 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:44.998321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95686897-5f09-45f8-b077-a6c04eb77e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:44.999326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95686897-5f09-45f8-b077-a6c04eb77e4b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.999777 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95686897-5f09-45f8-b077-a6c04eb77e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.000252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95686897-5f09-45f8-b077-a6c04eb77e4b None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.001227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95686897-5f09-45f8-b077-a6c04eb77e4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:45.001700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95686897-5f09-45f8-b077-a6c04eb77e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.003326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95686897-5f09-45f8-b077-a6c04eb77e4b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.012570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 85/160] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:45.018315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f367a6-e979-4d9b-9425-64f7f2f1bc09 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.117659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.155486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f367a6-e979-4d9b-9425-64f7f2f1bc09 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.196667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f1a6f-5bcd-4c13-a95e-27cf6003fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.197558 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1a6f-5bcd-4c13-a95e-27cf6003fa8b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.197841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1a6f-5bcd-4c13-a95e-27cf6003fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.198115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1a6f-5bcd-4c13-a95e-27cf6003fa8b None admin] PATH_INFO: `/v3/users/ad64baa998df4ef985f8ebf3cab5798b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.199371 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f1a6f-5bcd-4c13-a95e-27cf6003fa8b None admin] RBAC: Authorizing `identity:get_user(user_id=ad64baa998df4ef985f8ebf3cab5798b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.200842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f1a6f-5bcd-4c13-a95e-27cf6003fa8b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.202574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 76/161] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/users/ad64baa998df4ef985f8ebf3cab5798b => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:45.209072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95686897-5f09-45f8-b077-a6c04eb77e4b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.281980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.356393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95686897-5f09-45f8-b077-a6c04eb77e4b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.393200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d76fb-fe87-46ea-9089-f9f3cae362da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.394215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d76fb-fe87-46ea-9089-f9f3cae362da None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.394688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d76fb-fe87-46ea-9089-f9f3cae362da None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.395239 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d76fb-fe87-46ea-9089-f9f3cae362da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.405135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848fc71-ba09-45e4-8bfd-d77c2a22c697 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.405418 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848fc71-ba09-45e4-8bfd-d77c2a22c697 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.405696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848fc71-ba09-45e4-8bfd-d77c2a22c697 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.411229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 77/162] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:45.419150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80cd5d-875a-42c5-be8d-f6902a704b8c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.419440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80cd5d-875a-42c5-be8d-f6902a704b8c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.419727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80cd5d-875a-42c5-be8d-f6902a704b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.457059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8e80cd5d-875a-42c5-be8d-f6902a704b8c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:45.458375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8e80cd5d-875a-42c5-be8d-f6902a704b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:45.473478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d76fb-fe87-46ea-9089-f9f3cae362da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.475374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d76fb-fe87-46ea-9089-f9f3cae362da None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.530176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.543233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 78/163] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:45.563509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80cd5d-875a-42c5-be8d-f6902a704b8c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.587497 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 86/164] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:45.593220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d76fb-fe87-46ea-9089-f9f3cae362da None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.646461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.688574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80cd5d-875a-42c5-be8d-f6902a704b8c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.731950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d76fb-fe87-46ea-9089-f9f3cae362da None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.738307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6f1a5-151f-437c-a575-38dcdec3c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.739180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6f1a5-151f-437c-a575-38dcdec3c61f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.739464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6f1a5-151f-437c-a575-38dcdec3c61f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.739737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6f1a5-151f-437c-a575-38dcdec3c61f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.751370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6f1a5-151f-437c-a575-38dcdec3c61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-71a6f1a5-151f-437c-a575-38dcdec3c61f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:45.759007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:45.759869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:45.760674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:45.763208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 79/165] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:45.764587 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4e99-2a61-4296-bcf9-31c207abfc0a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.765078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4e99-2a61-4296-bcf9-31c207abfc0a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.765530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4e99-2a61-4296-bcf9-31c207abfc0a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.767016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 80/166] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:45.770877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c4e99-2a61-4296-bcf9-31c207abfc0a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.774984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4f8b8-ecac-4005-bc92-cea09c8f24d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.776106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f8b8-ecac-4005-bc92-cea09c8f24d5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.776580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f8b8-ecac-4005-bc92-cea09c8f24d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.777056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f8b8-ecac-4005-bc92-cea09c8f24d5 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.778419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4f8b8-ecac-4005-bc92-cea09c8f24d5 None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.780149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4f8b8-ecac-4005-bc92-cea09c8f24d5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.782201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 87/167] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:45.783677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b80d0-bb97-427d-b910-1e68691f9db1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.784152 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b80d0-bb97-427d-b910-1e68691f9db1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.784709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b80d0-bb97-427d-b910-1e68691f9db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.803919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5e0b80d0-bb97-427d-b910-1e68691f9db1 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:45.805595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e0b80d0-bb97-427d-b910-1e68691f9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:45.820725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.883675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c4e99-2a61-4296-bcf9-31c207abfc0a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.884607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 88/168] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:45.885789 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b80d0-bb97-427d-b910-1e68691f9db1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.913271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.921417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e28d1-9f92-48f0-882b-ccbd8be5caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.922327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e28d1-9f92-48f0-882b-ccbd8be5caed None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.922765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e28d1-9f92-48f0-882b-ccbd8be5caed None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.923372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e28d1-9f92-48f0-882b-ccbd8be5caed None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.933874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e28d1-9f92-48f0-882b-ccbd8be5caed None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:45.933874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e28d1-9f92-48f0-882b-ccbd8be5caed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.933874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e28d1-9f92-48f0-882b-ccbd8be5caed None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.940391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 81/169] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:45.941482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e28d1-9f92-48f0-882b-ccbd8be5caed None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.996247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b80d0-bb97-427d-b910-1e68691f9db1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.034427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0302df-a9a6-4d17-abfc-b855e6d51a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.035134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0302df-a9a6-4d17-abfc-b855e6d51a9d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.036215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0302df-a9a6-4d17-abfc-b855e6d51a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.036561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0302df-a9a6-4d17-abfc-b855e6d51a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.037580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0302df-a9a6-4d17-abfc-b855e6d51a9d None admin] RBAC: Adding query filter params (role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=372aa814f19d46d68ffb05087f0d23f8, user.id=ad64baa998df4ef985f8ebf3cab5798b) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:46.037956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0302df-a9a6-4d17-abfc-b855e6d51a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.039534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0302df-a9a6-4d17-abfc-b855e6d51a9d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.046587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 89/170] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/role_assignments?user.id=ad64baa998df4ef985f8ebf3cab5798b&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:46.047569 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0302df-a9a6-4d17-abfc-b855e6d51a9d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.063860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.133859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e28d1-9f92-48f0-882b-ccbd8be5caed None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.162407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0302df-a9a6-4d17-abfc-b855e6d51a9d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.178410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b36a-aa29-4bc5-98fd-55d8020e4e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.179346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b36a-aa29-4bc5-98fd-55d8020e4e6d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.179626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b36a-aa29-4bc5-98fd-55d8020e4e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.179964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b36a-aa29-4bc5-98fd-55d8020e4e6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.193385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579b36a-aa29-4bc5-98fd-55d8020e4e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1579b36a-aa29-4bc5-98fd-55d8020e4e6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:46.201157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:46.202134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:46.203588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 82/171] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:46.209248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b36a-aa29-4bc5-98fd-55d8020e4e6d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.240478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36470f37-50bd-42d1-9ecd-fe00df82a206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.241389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36470f37-50bd-42d1-9ecd-fe00df82a206 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.241669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36470f37-50bd-42d1-9ecd-fe00df82a206 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.241942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36470f37-50bd-42d1-9ecd-fe00df82a206 None admin] PATH_INFO: `/v3/users/ad64baa998df4ef985f8ebf3cab5798b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.243253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36470f37-50bd-42d1-9ecd-fe00df82a206 None admin] RBAC: Authorizing `identity:get_user(user_id=ad64baa998df4ef985f8ebf3cab5798b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.244703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36470f37-50bd-42d1-9ecd-fe00df82a206 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.246634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 90/172] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/users/ad64baa998df4ef985f8ebf3cab5798b => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:46.252790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36470f37-50bd-42d1-9ecd-fe00df82a206 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.293374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.397690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b36a-aa29-4bc5-98fd-55d8020e4e6d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.470945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12796c-4f6f-45f7-b27c-dae78e86e41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.471902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12796c-4f6f-45f7-b27c-dae78e86e41d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.472337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12796c-4f6f-45f7-b27c-dae78e86e41d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.472811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12796c-4f6f-45f7-b27c-dae78e86e41d None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.474220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12796c-4f6f-45f7-b27c-dae78e86e41d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:46.474681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.477377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12796c-4f6f-45f7-b27c-dae78e86e41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.479007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12796c-4f6f-45f7-b27c-dae78e86e41d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.491364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 83/173] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:46.498098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12796c-4f6f-45f7-b27c-dae78e86e41d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.499524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36470f37-50bd-42d1-9ecd-fe00df82a206 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.534827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715bbbb-a40c-4994-9b98-cd45e984fbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.536355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715bbbb-a40c-4994-9b98-cd45e984fbea None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.536776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715bbbb-a40c-4994-9b98-cd45e984fbea None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.537235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715bbbb-a40c-4994-9b98-cd45e984fbea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.610749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715bbbb-a40c-4994-9b98-cd45e984fbea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.612458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715bbbb-a40c-4994-9b98-cd45e984fbea None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.647471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12796c-4f6f-45f7-b27c-dae78e86e41d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.665048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.695275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbc520-9bcb-42f6-8bf2-84a1a252eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.696213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbc520-9bcb-42f6-8bf2-84a1a252eacd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.696495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbc520-9bcb-42f6-8bf2-84a1a252eacd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.696765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbc520-9bcb-42f6-8bf2-84a1a252eacd None admin] PATH_INFO: `/v3/users/8ee8c41befe5418c95bad9a434d99f95` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.701402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.703861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbc520-9bcb-42f6-8bf2-84a1a252eacd None admin] RBAC: Authorizing `identity:get_user(user_id=8ee8c41befe5418c95bad9a434d99f95)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.705323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbc520-9bcb-42f6-8bf2-84a1a252eacd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.707606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 84/174] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/users/8ee8c41befe5418c95bad9a434d99f95 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:46.713130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbc520-9bcb-42f6-8bf2-84a1a252eacd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.725617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 91/175] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:46.731887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715bbbb-a40c-4994-9b98-cd45e984fbea None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.841449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715bbbb-a40c-4994-9b98-cd45e984fbea None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.880246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f0a00-8f30-4be4-b74a-1d74e38d5c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.880246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f0a00-8f30-4be4-b74a-1d74e38d5c67 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.880659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f0a00-8f30-4be4-b74a-1d74e38d5c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.881130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f0a00-8f30-4be4-b74a-1d74e38d5c67 None admin] PATH_INFO: `/v3/projects/f5484221369c40e6a5c6a9c6c372cd84` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.882492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f0a00-8f30-4be4-b74a-1d74e38d5c67 None admin] RBAC: Authorizing `identity:get_project(project_id=f5484221369c40e6a5c6a9c6c372cd84)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.884130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f0a00-8f30-4be4-b74a-1d74e38d5c67 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.886412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 92/176] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/projects/f5484221369c40e6a5c6a9c6c372cd84 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:46.892965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f0a00-8f30-4be4-b74a-1d74e38d5c67 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.953039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbc520-9bcb-42f6-8bf2-84a1a252eacd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:47.018019 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:47.034411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330f4b7-054e-4c8c-9ce5-69cfcb504c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:47.036096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f4b7-054e-4c8c-9ce5-69cfcb504c61 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.040460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f4b7-054e-4c8c-9ce5-69cfcb504c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.040460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330f4b7-054e-4c8c-9ce5-69cfcb504c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.120630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f0a00-8f30-4be4-b74a-1d74e38d5c67 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:47.132897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:47.160927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71c2c-3cab-4cf9-9805-ebb69d2779e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:47.161876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71c2c-3cab-4cf9-9805-ebb69d2779e1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.162294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71c2c-3cab-4cf9-9805-ebb69d2779e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.162713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71c2c-3cab-4cf9-9805-ebb69d2779e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.163269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f4b7-054e-4c8c-9ce5-69cfcb504c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:47.163906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d71c2c-3cab-4cf9-9805-ebb69d2779e1 None admin] RBAC: Adding query filter params (role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=f5484221369c40e6a5c6a9c6c372cd84, user.id=ad64baa998df4ef985f8ebf3cab5798b) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:47.164369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d71c2c-3cab-4cf9-9805-ebb69d2779e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:47.164751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330f4b7-054e-4c8c-9ce5-69cfcb504c61 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:47.166104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d71c2c-3cab-4cf9-9805-ebb69d2779e1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:47.173174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 93/177] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/role_assignments?user.id=ad64baa998df4ef985f8ebf3cab5798b&scope.project.id=f5484221369c40e6a5c6a9c6c372cd84&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:47.310685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 85/178] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:47.317016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71c2c-3cab-4cf9-9805-ebb69d2779e1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:47.446611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b91762-18a2-4f2b-a853-7f04596b3137 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.446779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b91762-18a2-4f2b-a853-7f04596b3137 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.447060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b91762-18a2-4f2b-a853-7f04596b3137 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.448512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 86/179] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:47.460204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760feec-9708-4f56-91cb-212dfb16e792 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.460520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760feec-9708-4f56-91cb-212dfb16e792 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.460775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760feec-9708-4f56-91cb-212dfb16e792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.475322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71c2c-3cab-4cf9-9805-ebb69d2779e1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:47.490667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b760feec-9708-4f56-91cb-212dfb16e792 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:47.491945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b760feec-9708-4f56-91cb-212dfb16e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:47.508924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:47.555279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b0cc2-58ca-4893-be6f-0685ab64e677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:47.556168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b0cc2-58ca-4893-be6f-0685ab64e677 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.556452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b0cc2-58ca-4893-be6f-0685ab64e677 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.556728 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b0cc2-58ca-4893-be6f-0685ab64e677 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.558152 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b0cc2-58ca-4893-be6f-0685ab64e677 None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:47.560746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b0cc2-58ca-4893-be6f-0685ab64e677 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:47.562845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 94/180] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:47 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:47.570126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b0cc2-58ca-4893-be6f-0685ab64e677 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:47.640408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 87/181] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:47.688011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760feec-9708-4f56-91cb-212dfb16e792 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:47.708435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b0cc2-58ca-4893-be6f-0685ab64e677 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:47.711588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:47.753380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a88594-9214-4aee-9c80-7f06b75d08e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:47.754578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a88594-9214-4aee-9c80-7f06b75d08e2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.754886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a88594-9214-4aee-9c80-7f06b75d08e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.755994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a88594-9214-4aee-9c80-7f06b75d08e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.757314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a88594-9214-4aee-9c80-7f06b75d08e2 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=372aa814f19d46d68ffb05087f0d23f8, user.id=8ee8c41befe5418c95bad9a434d99f95) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:47.757630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a88594-9214-4aee-9c80-7f06b75d08e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:47.759076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a88594-9214-4aee-9c80-7f06b75d08e2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:47.768761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 95/182] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:47 2022] GET /identity/v3/role_assignments?user.id=8ee8c41befe5418c95bad9a434d99f95&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:47.775977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d7d87-b8a3-4494-b4a8-115fe9c6744c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.776276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d7d87-b8a3-4494-b4a8-115fe9c6744c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.776545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d7d87-b8a3-4494-b4a8-115fe9c6744c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.781441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 96/183] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:47.785486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3ce9f-b70c-4640-90c2-90a09eb5b419 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.785775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3ce9f-b70c-4640-90c2-90a09eb5b419 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.786057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3ce9f-b70c-4640-90c2-90a09eb5b419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.819358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-baf3ce9f-b70c-4640-90c2-90a09eb5b419 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:47.827114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-baf3ce9f-b70c-4640-90c2-90a09eb5b419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:47.884005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760feec-9708-4f56-91cb-212dfb16e792 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:47.916179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:47.949674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e6ba3-ede0-4eb8-b475-744ba735080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:47.949883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 97/184] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:47.950573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e6ba3-ede0-4eb8-b475-744ba735080f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.950862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e6ba3-ede0-4eb8-b475-744ba735080f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.951158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e6ba3-ede0-4eb8-b475-744ba735080f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.951259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441355-4b13-474e-868c-3e657c77fba2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.951506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441355-4b13-474e-868c-3e657c77fba2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.951783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441355-4b13-474e-868c-3e657c77fba2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.953150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 98/185] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:47.955352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29a352-afd7-4aed-9239-db71a3497002 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.955636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29a352-afd7-4aed-9239-db71a3497002 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.955917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29a352-afd7-4aed-9239-db71a3497002 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.957509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 99/186] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:47.964661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8bdcd-6ffb-4f8c-a15c-36b911c77567 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.964928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8bdcd-6ffb-4f8c-a15c-36b911c77567 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.965141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8bdcd-6ffb-4f8c-a15c-36b911c77567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.973782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e6ba3-ede0-4eb8-b475-744ba735080f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c46e6ba3-ede0-4eb8-b475-744ba735080f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:47.982094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:47.983047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:47.983868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 88/187] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:47.985560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2adc0-4251-4a2c-b1fe-d61b458ac805 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.985560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2adc0-4251-4a2c-b1fe-d61b458ac805 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.985719 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2adc0-4251-4a2c-b1fe-d61b458ac805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.992254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-17d8bdcd-6ffb-4f8c-a15c-36b911c77567 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:47.993505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-17d8bdcd-6ffb-4f8c-a15c-36b911c77567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:48.004705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fcf2adc0-4251-4a2c-b1fe-d61b458ac805 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:48.006661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fcf2adc0-4251-4a2c-b1fe-d61b458ac805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:48.073989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 100/188] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:48.081449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8bdcd-6ffb-4f8c-a15c-36b911c77567 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.086229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.090976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 89/189] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:48.091843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2adc0-4251-4a2c-b1fe-d61b458ac805 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.184312 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8bdcd-6ffb-4f8c-a15c-36b911c77567 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.186557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.194310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2adc0-4251-4a2c-b1fe-d61b458ac805 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.217823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d74334-bec6-4e7c-a376-9d4f0521b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.218558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74334-bec6-4e7c-a376-9d4f0521b6fa None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.218837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74334-bec6-4e7c-a376-9d4f0521b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.219133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74334-bec6-4e7c-a376-9d4f0521b6fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.227736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939a7b1-3619-4598-a3db-af9ad3d95d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.228399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939a7b1-3619-4598-a3db-af9ad3d95d65 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.228708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939a7b1-3619-4598-a3db-af9ad3d95d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.228981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939a7b1-3619-4598-a3db-af9ad3d95d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.229527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d74334-bec6-4e7c-a376-9d4f0521b6fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:48.229723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939a7b1-3619-4598-a3db-af9ad3d95d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:48.230023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939a7b1-3619-4598-a3db-af9ad3d95d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.231430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939a7b1-3619-4598-a3db-af9ad3d95d65 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-63d74334-bec6-4e7c-a376-9d4f0521b6fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:48.237111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:48.238782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 101/190] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:48.239655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d74334-bec6-4e7c-a376-9d4f0521b6fa None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.242490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 90/191] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.243298 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939a7b1-3619-4598-a3db-af9ad3d95d65 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.312084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.341934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d74334-bec6-4e7c-a376-9d4f0521b6fa None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.350181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939a7b1-3619-4598-a3db-af9ad3d95d65 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.375529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7af04-3ddc-4cd0-b732-7bb4880c7231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.376331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7af04-3ddc-4cd0-b732-7bb4880c7231 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.376612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7af04-3ddc-4cd0-b732-7bb4880c7231 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.376880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7af04-3ddc-4cd0-b732-7bb4880c7231 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.383393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52ae4d-0d70-4e8a-96fc-dabb364259f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.384180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52ae4d-0d70-4e8a-96fc-dabb364259f0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.384465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52ae4d-0d70-4e8a-96fc-dabb364259f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.384743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52ae4d-0d70-4e8a-96fc-dabb364259f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.385890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52ae4d-0d70-4e8a-96fc-dabb364259f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.387210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7af04-3ddc-4cd0-b732-7bb4880c7231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:48.387365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52ae4d-0d70-4e8a-96fc-dabb364259f0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.389170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 91/192] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.389708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52ae4d-0d70-4e8a-96fc-dabb364259f0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c4b7af04-3ddc-4cd0-b732-7bb4880c7231 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:48.396915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:48.397773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:48.398582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 102/193] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:48.399697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7af04-3ddc-4cd0-b732-7bb4880c7231 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.426266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.490230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52ae4d-0d70-4e8a-96fc-dabb364259f0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.498719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7af04-3ddc-4cd0-b732-7bb4880c7231 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.517940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.524077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc2c1-8ff9-491e-bc77-c132e8106ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.524744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc2c1-8ff9-491e-bc77-c132e8106ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.525024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc2c1-8ff9-491e-bc77-c132e8106ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.525300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc2c1-8ff9-491e-bc77-c132e8106ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.526039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fc2c1-8ff9-491e-bc77-c132e8106ef6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:48.526342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fc2c1-8ff9-491e-bc77-c132e8106ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.527720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fc2c1-8ff9-491e-bc77-c132e8106ef6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.531636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de570ca8-7c4f-4e90-842b-3cf7b6627330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.532502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de570ca8-7c4f-4e90-842b-3cf7b6627330 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.532786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de570ca8-7c4f-4e90-842b-3cf7b6627330 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.533059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de570ca8-7c4f-4e90-842b-3cf7b6627330 None admin] PATH_INFO: `/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.535629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 92/194] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.536392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc2c1-8ff9-491e-bc77-c132e8106ef6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.549847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de570ca8-7c4f-4e90-842b-3cf7b6627330 None admin] RBAC: Authorizing `identity:get_user(user_id=3cbcd20b6eb24b18a2a321f24f36a00d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.551328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de570ca8-7c4f-4e90-842b-3cf7b6627330 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.553015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 103/195] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.553015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de570ca8-7c4f-4e90-842b-3cf7b6627330 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.632414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.637608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc2c1-8ff9-491e-bc77-c132e8106ef6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.650051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de570ca8-7c4f-4e90-842b-3cf7b6627330 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.670326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519cc78-0956-4be3-b6d1-a92c20de009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.670989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519cc78-0956-4be3-b6d1-a92c20de009e None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.671299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519cc78-0956-4be3-b6d1-a92c20de009e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.671571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519cc78-0956-4be3-b6d1-a92c20de009e None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.672271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519cc78-0956-4be3-b6d1-a92c20de009e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.673678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519cc78-0956-4be3-b6d1-a92c20de009e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.683225 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce0d57-6c13-40b9-925a-5cbcc80690c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.683887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce0d57-6c13-40b9-925a-5cbcc80690c2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.684173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce0d57-6c13-40b9-925a-5cbcc80690c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.684447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce0d57-6c13-40b9-925a-5cbcc80690c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.685184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce0d57-6c13-40b9-925a-5cbcc80690c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:48.685490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce0d57-6c13-40b9-925a-5cbcc80690c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.686834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce0d57-6c13-40b9-925a-5cbcc80690c2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.695249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 104/196] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.696021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce0d57-6c13-40b9-925a-5cbcc80690c2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.779157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 93/197] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:48 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:48.779997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519cc78-0956-4be3-b6d1-a92c20de009e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.794258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce0d57-6c13-40b9-925a-5cbcc80690c2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.833623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67aa0-157c-4257-bbd6-1e11578c4861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.834850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.835422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67aa0-157c-4257-bbd6-1e11578c4861 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.836231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67aa0-157c-4257-bbd6-1e11578c4861 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.836742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67aa0-157c-4257-bbd6-1e11578c4861 None admin] PATH_INFO: `/v3/users/ddb815e590084a93adff696fedc4b993` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.838296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe67aa0-157c-4257-bbd6-1e11578c4861 None admin] RBAC: Authorizing `identity:get_user(user_id=ddb815e590084a93adff696fedc4b993)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.840066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe67aa0-157c-4257-bbd6-1e11578c4861 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.842026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 105/198] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/users/ddb815e590084a93adff696fedc4b993 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.843071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67aa0-157c-4257-bbd6-1e11578c4861 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.861365 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.896619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519cc78-0956-4be3-b6d1-a92c20de009e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.932800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7c4e4-414d-49d8-b833-ef3d73270436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.933460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7c4e4-414d-49d8-b833-ef3d73270436 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.933712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7c4e4-414d-49d8-b833-ef3d73270436 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.933978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7c4e4-414d-49d8-b833-ef3d73270436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.957324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67aa0-157c-4257-bbd6-1e11578c4861 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.996872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eb643-08e0-4889-a582-1a4e03560dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.997755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eb643-08e0-4889-a582-1a4e03560dce None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.998038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eb643-08e0-4889-a582-1a4e03560dce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.998317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eb643-08e0-4889-a582-1a4e03560dce None admin] PATH_INFO: `/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.999924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9eb643-08e0-4889-a582-1a4e03560dce None admin] RBAC: Authorizing `identity:get_user(user_id=3cbcd20b6eb24b18a2a321f24f36a00d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.002366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9eb643-08e0-4889-a582-1a4e03560dce None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.003213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 106/199] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:49.004470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eb643-08e0-4889-a582-1a4e03560dce None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.016388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7c4e4-414d-49d8-b833-ef3d73270436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.017957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7c4e4-414d-49d8-b833-ef3d73270436 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.081912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.107434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.130920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eb643-08e0-4889-a582-1a4e03560dce None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.151947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 94/200] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:49.152893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7c4e4-414d-49d8-b833-ef3d73270436 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.173952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e902e5-ed3c-4135-a037-5c95767a8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.174509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e902e5-ed3c-4135-a037-5c95767a8baf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.174793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e902e5-ed3c-4135-a037-5c95767a8baf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.175064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e902e5-ed3c-4135-a037-5c95767a8baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.249800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e902e5-ed3c-4135-a037-5c95767a8baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.251544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e902e5-ed3c-4135-a037-5c95767a8baf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.287337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7c4e4-414d-49d8-b833-ef3d73270436 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.334756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f1f66-d237-4f5c-b1c2-e17a0a06221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.335369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f1f66-d237-4f5c-b1c2-e17a0a06221a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.335657 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f1f66-d237-4f5c-b1c2-e17a0a06221a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.335932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f1f66-d237-4f5c-b1c2-e17a0a06221a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.341695 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.359863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.371561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 107/201] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:49.375950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e902e5-ed3c-4135-a037-5c95767a8baf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.426849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f1f66-d237-4f5c-b1c2-e17a0a06221a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f1f66-d237-4f5c-b1c2-e17a0a06221a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.488764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e902e5-ed3c-4135-a037-5c95767a8baf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.524252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ed1b1-6690-4307-97ca-a8b4e3ecd759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.525115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed1b1-6690-4307-97ca-a8b4e3ecd759 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.525389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed1b1-6690-4307-97ca-a8b4e3ecd759 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.525664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed1b1-6690-4307-97ca-a8b4e3ecd759 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.526949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ed1b1-6690-4307-97ca-a8b4e3ecd759 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.528433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ed1b1-6690-4307-97ca-a8b4e3ecd759 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.530310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 108/202] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:49.536051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ed1b1-6690-4307-97ca-a8b4e3ecd759 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.562825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 95/203] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:49.564136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f1f66-d237-4f5c-b1c2-e17a0a06221a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.588590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.628965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.652431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ed1b1-6690-4307-97ca-a8b4e3ecd759 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.681253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f1f66-d237-4f5c-b1c2-e17a0a06221a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.697076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a5d9d-1a0a-4634-aadf-8ac3372e89b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.698210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a5d9d-1a0a-4634-aadf-8ac3372e89b3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.698492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a5d9d-1a0a-4634-aadf-8ac3372e89b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.698769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a5d9d-1a0a-4634-aadf-8ac3372e89b3 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.700462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a5d9d-1a0a-4634-aadf-8ac3372e89b3 None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.701910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a5d9d-1a0a-4634-aadf-8ac3372e89b3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.709327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 109/204] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:49.709327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a5d9d-1a0a-4634-aadf-8ac3372e89b3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.724741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85e7bf-06b5-4b34-ad4b-4423c13ac157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.725563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85e7bf-06b5-4b34-ad4b-4423c13ac157 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.726170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85e7bf-06b5-4b34-ad4b-4423c13ac157 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.726534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85e7bf-06b5-4b34-ad4b-4423c13ac157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.728585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85e7bf-06b5-4b34-ad4b-4423c13ac157 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=fcdefa8d9129437abc74ff4d6d386083, user.id=3cbcd20b6eb24b18a2a321f24f36a00d) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:49.729160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85e7bf-06b5-4b34-ad4b-4423c13ac157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.730813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85e7bf-06b5-4b34-ad4b-4423c13ac157 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.736904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 96/205] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/role_assignments?user.id=3cbcd20b6eb24b18a2a321f24f36a00d&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:49.737987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85e7bf-06b5-4b34-ad4b-4423c13ac157 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.869083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a5d9d-1a0a-4634-aadf-8ac3372e89b3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.903496 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.910036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13bad3-fa28-487d-87d0-98bad98c43ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bad3-fa28-487d-87d0-98bad98c43ce None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.911836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bad3-fa28-487d-87d0-98bad98c43ce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.912301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bad3-fa28-487d-87d0-98bad98c43ce None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.913802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13bad3-fa28-487d-87d0-98bad98c43ce None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.915536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13bad3-fa28-487d-87d0-98bad98c43ce None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.917645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 110/206] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:49.928418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13bad3-fa28-487d-87d0-98bad98c43ce None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.942853 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85e7bf-06b5-4b34-ad4b-4423c13ac157 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.969978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:50.001962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e49914-9bb8-4da8-9bdb-fb0d3e253123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:50.002968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49914-9bb8-4da8-9bdb-fb0d3e253123 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:50.003342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49914-9bb8-4da8-9bdb-fb0d3e253123 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:50.004335 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e49914-9bb8-4da8-9bdb-fb0d3e253123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:50.005782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e49914-9bb8-4da8-9bdb-fb0d3e253123 None admin] RBAC: Adding query filter params (role.id=61c5b1b2390148b883b9a95a739b6736, scope.project.id=372aa814f19d46d68ffb05087f0d23f8, user.id=ddb815e590084a93adff696fedc4b993) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:50.006236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e49914-9bb8-4da8-9bdb-fb0d3e253123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:50.008183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e49914-9bb8-4da8-9bdb-fb0d3e253123 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:50.023033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 97/207] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/role_assignments?user.id=ddb815e590084a93adff696fedc4b993&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=61c5b1b2390148b883b9a95a739b6736 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:50.092374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13bad3-fa28-487d-87d0-98bad98c43ce None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:50.147485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc92178-35d1-40a3-92fb-fd4d696b5aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:50.148099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc92178-35d1-40a3-92fb-fd4d696b5aca None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:50.148384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc92178-35d1-40a3-92fb-fd4d696b5aca None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:50.148661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc92178-35d1-40a3-92fb-fd4d696b5aca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:50.149529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc92178-35d1-40a3-92fb-fd4d696b5aca None admin] RBAC: Adding query filter params (role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=fcdefa8d9129437abc74ff4d6d386083, user.id=3cbcd20b6eb24b18a2a321f24f36a00d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:50.149845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc92178-35d1-40a3-92fb-fd4d696b5aca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:50.151388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc92178-35d1-40a3-92fb-fd4d696b5aca None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:50.157877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 111/208] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/role_assignments?user.id=3cbcd20b6eb24b18a2a321f24f36a00d&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:51.245211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d388b-3f8c-4e88-bad0-d1426a270b3c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.245764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d388b-3f8c-4e88-bad0-d1426a270b3c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.245764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d388b-3f8c-4e88-bad0-d1426a270b3c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.247365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 98/209] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:51.252662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6df87-33df-45a1-9b44-8cab9f67f833 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.253532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6df87-33df-45a1-9b44-8cab9f67f833 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.254519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6df87-33df-45a1-9b44-8cab9f67f833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.275167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5ca6df87-33df-45a1-9b44-8cab9f67f833 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:51.276586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5ca6df87-33df-45a1-9b44-8cab9f67f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:51.321078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:51.344031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 112/210] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:51.368782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d388b-3f8c-4e88-bad0-d1426a270b3c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.381313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115363a-795c-4094-a488-bac147a42607 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.381602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115363a-795c-4094-a488-bac147a42607 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.381859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115363a-795c-4094-a488-bac147a42607 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.383405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 113/211] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:51.388160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb901fc-0e8e-48bd-945d-9488f6c9abf8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.388629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb901fc-0e8e-48bd-945d-9488f6c9abf8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.389055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb901fc-0e8e-48bd-945d-9488f6c9abf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.405890 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4fb901fc-0e8e-48bd-945d-9488f6c9abf8 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:51.407313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4fb901fc-0e8e-48bd-945d-9488f6c9abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:51.479683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 114/212] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:51.492416 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d388b-3f8c-4e88-bad0-d1426a270b3c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:51.504307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb901fc-0e8e-48bd-945d-9488f6c9abf8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.531762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff0c40-be7b-4e7e-a248-0097695533af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:51.533080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff0c40-be7b-4e7e-a248-0097695533af None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.533511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff0c40-be7b-4e7e-a248-0097695533af None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.534084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff0c40-be7b-4e7e-a248-0097695533af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.548665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff0c40-be7b-4e7e-a248-0097695533af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-23ff0c40-be7b-4e7e-a248-0097695533af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:51.558841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:51.559957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:51.560936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:51.563479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 99/213] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:51.569940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff0c40-be7b-4e7e-a248-0097695533af None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.617098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:51.636877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb901fc-0e8e-48bd-945d-9488f6c9abf8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:51.650896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:51.683199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8084-bb4f-41d7-8fc7-5ad6e451dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:51.684513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8084-bb4f-41d7-8fc7-5ad6e451dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.685198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8084-bb4f-41d7-8fc7-5ad6e451dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.686025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8084-bb4f-41d7-8fc7-5ad6e451dcf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.687639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8084-bb4f-41d7-8fc7-5ad6e451dcf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:51.690120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8084-bb4f-41d7-8fc7-5ad6e451dcf7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:51.691670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff0c40-be7b-4e7e-a248-0097695533af None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:51.695246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 115/214] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:51.697845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8084-bb4f-41d7-8fc7-5ad6e451dcf7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.733093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0deb85-e772-46a6-a140-e202c127c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:51.734059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0deb85-e772-46a6-a140-e202c127c5cc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.734614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0deb85-e772-46a6-a140-e202c127c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.735119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0deb85-e772-46a6-a140-e202c127c5cc None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.736120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0deb85-e772-46a6-a140-e202c127c5cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:51.736641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0deb85-e772-46a6-a140-e202c127c5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:51.738443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0deb85-e772-46a6-a140-e202c127c5cc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:51.748771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 100/215] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:51.754539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0deb85-e772-46a6-a140-e202c127c5cc None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.819264 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8084-bb4f-41d7-8fc7-5ad6e451dcf7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:51.857581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82d4e2-70b2-4cfb-b4dc-46af29719c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:51.858318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82d4e2-70b2-4cfb-b4dc-46af29719c64 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.858667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82d4e2-70b2-4cfb-b4dc-46af29719c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.858952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82d4e2-70b2-4cfb-b4dc-46af29719c64 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.860011 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82d4e2-70b2-4cfb-b4dc-46af29719c64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:51.861213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82d4e2-70b2-4cfb-b4dc-46af29719c64 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:51.886545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:51.892243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0deb85-e772-46a6-a140-e202c127c5cc None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:51.928697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e00f5-d0ca-4712-8066-0d5cd51b4a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:51.929630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e00f5-d0ca-4712-8066-0d5cd51b4a6d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.929910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e00f5-d0ca-4712-8066-0d5cd51b4a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.930175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e00f5-d0ca-4712-8066-0d5cd51b4a6d None admin] PATH_INFO: `/v3/users/50793af1fd6341e28794c7bb481bbc40` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.944313 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e00f5-d0ca-4712-8066-0d5cd51b4a6d None admin] RBAC: Authorizing `identity:get_user(user_id=50793af1fd6341e28794c7bb481bbc40)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:51.946471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e00f5-d0ca-4712-8066-0d5cd51b4a6d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:51.948926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 101/216] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:51 2022] GET /identity/v3/users/50793af1fd6341e28794c7bb481bbc40 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:51.954029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e00f5-d0ca-4712-8066-0d5cd51b4a6d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.991119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 116/217] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:51 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:52.078923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e00f5-d0ca-4712-8066-0d5cd51b4a6d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.116374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a19f1-921d-4dde-b964-a966975592ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.117030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a19f1-921d-4dde-b964-a966975592ee None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.117306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a19f1-921d-4dde-b964-a966975592ee None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.117575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a19f1-921d-4dde-b964-a966975592ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.150948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:52.204811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a19f1-921d-4dde-b964-a966975592ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:52.207309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a19f1-921d-4dde-b964-a966975592ee None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:52.221396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ec42-4a00-42db-b5ae-12f1c9dc8bfb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.221720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ec42-4a00-42db-b5ae-12f1c9dc8bfb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.221940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ec42-4a00-42db-b5ae-12f1c9dc8bfb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.223515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 117/218] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:52.230611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219c786-a337-4b50-9a0d-d1d78c782917 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.230896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219c786-a337-4b50-9a0d-d1d78c782917 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.231199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219c786-a337-4b50-9a0d-d1d78c782917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.257065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d219c786-a337-4b50-9a0d-d1d78c782917 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:52.258369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d219c786-a337-4b50-9a0d-d1d78c782917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:52.299450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:52.336437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 102/219] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:52.341736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a19f1-921d-4dde-b964-a966975592ee None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.354150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 118/220] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:52.379877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219c786-a337-4b50-9a0d-d1d78c782917 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.410687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:52.470986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a19f1-921d-4dde-b964-a966975592ee None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.518368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219c786-a337-4b50-9a0d-d1d78c782917 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.518673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c95db1-e780-4ff8-b65d-9448530f2ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.519585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95db1-e780-4ff8-b65d-9448530f2ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.519863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95db1-e780-4ff8-b65d-9448530f2ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.520132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95db1-e780-4ff8-b65d-9448530f2ea9 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.521678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c95db1-e780-4ff8-b65d-9448530f2ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:52.523126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c95db1-e780-4ff8-b65d-9448530f2ea9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:52.525124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 103/221] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:52.532186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c95db1-e780-4ff8-b65d-9448530f2ea9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.568525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da91b0-618f-4b16-8b11-4e2499aa3e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.569729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da91b0-618f-4b16-8b11-4e2499aa3e7e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.570017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da91b0-618f-4b16-8b11-4e2499aa3e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.570558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da91b0-618f-4b16-8b11-4e2499aa3e7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.585199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da91b0-618f-4b16-8b11-4e2499aa3e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-90da91b0-618f-4b16-8b11-4e2499aa3e7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:52.594493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:52.595399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:52.596595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 119/222] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:52.597469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1055f11-53ba-4146-9c41-d2b451e1beed None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.597469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1055f11-53ba-4146-9c41-d2b451e1beed None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.597596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1055f11-53ba-4146-9c41-d2b451e1beed None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.599018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 120/223] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:52.603988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1055f11-53ba-4146-9c41-d2b451e1beed None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.638287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:52.664240 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c95db1-e780-4ff8-b65d-9448530f2ea9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.689764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:52.702044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc54cb-345d-4093-af33-4b4e81a715ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.706487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc54cb-345d-4093-af33-4b4e81a715ad None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.706487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc54cb-345d-4093-af33-4b4e81a715ad None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.706487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc54cb-345d-4093-af33-4b4e81a715ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.706487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc54cb-345d-4093-af33-4b4e81a715ad None admin] RBAC: Adding query filter params (role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=fcdefa8d9129437abc74ff4d6d386083, user.id=50793af1fd6341e28794c7bb481bbc40) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:52.706487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc54cb-345d-4093-af33-4b4e81a715ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:52.706487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc54cb-345d-4093-af33-4b4e81a715ad None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:52.712424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 104/224] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/role_assignments?user.id=50793af1fd6341e28794c7bb481bbc40&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:52.713864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607326f8-1764-4ccb-91e3-8ebde7b99483 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.714350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607326f8-1764-4ccb-91e3-8ebde7b99483 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.714824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607326f8-1764-4ccb-91e3-8ebde7b99483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.732255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-607326f8-1764-4ccb-91e3-8ebde7b99483 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:52.733737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-607326f8-1764-4ccb-91e3-8ebde7b99483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:52.745056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1055f11-53ba-4146-9c41-d2b451e1beed None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.811215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 105/225] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:52.822410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448f42-24da-41bf-9746-abec32123c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.823115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448f42-24da-41bf-9746-abec32123c75 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.823395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448f42-24da-41bf-9746-abec32123c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.823662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448f42-24da-41bf-9746-abec32123c75 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.824422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448f42-24da-41bf-9746-abec32123c75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:52.824727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448f42-24da-41bf-9746-abec32123c75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:52.826112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448f42-24da-41bf-9746-abec32123c75 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:52.836065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607326f8-1764-4ccb-91e3-8ebde7b99483 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.848623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 121/226] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:52.854534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448f42-24da-41bf-9746-abec32123c75 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.963839 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607326f8-1764-4ccb-91e3-8ebde7b99483 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.984751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:53.006489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169214a-cbf8-4b70-a73a-5f176e75c607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:53.007711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169214a-cbf8-4b70-a73a-5f176e75c607 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:53.010564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169214a-cbf8-4b70-a73a-5f176e75c607 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:53.011078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169214a-cbf8-4b70-a73a-5f176e75c607 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:53.039564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169214a-cbf8-4b70-a73a-5f176e75c607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f169214a-cbf8-4b70-a73a-5f176e75c607 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:53.042140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:53.042993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:53.043801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 106/227] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:53.050809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169214a-cbf8-4b70-a73a-5f176e75c607 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:53.079456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:53.110374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448f42-24da-41bf-9746-abec32123c75 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:53.173598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485d63a-466e-46df-9f39-4c3a554d425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:53.174482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485d63a-466e-46df-9f39-4c3a554d425c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:53.174760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485d63a-466e-46df-9f39-4c3a554d425c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:53.175031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485d63a-466e-46df-9f39-4c3a554d425c None admin] PATH_INFO: `/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:53.176364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485d63a-466e-46df-9f39-4c3a554d425c None admin] RBAC: Authorizing `identity:get_user(user_id=3cbcd20b6eb24b18a2a321f24f36a00d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:53.177852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485d63a-466e-46df-9f39-4c3a554d425c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:53.179543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 122/228] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:53.185041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485d63a-466e-46df-9f39-4c3a554d425c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:53.221090 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169214a-cbf8-4b70-a73a-5f176e75c607 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:53.289852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcdd18-fee7-467d-9d48-355070896e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:53.290521 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcdd18-fee7-467d-9d48-355070896e17 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:53.290799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcdd18-fee7-467d-9d48-355070896e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:53.291069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcdd18-fee7-467d-9d48-355070896e17 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:53.291834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcdd18-fee7-467d-9d48-355070896e17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:53.292189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcdd18-fee7-467d-9d48-355070896e17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:53.294381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcdd18-fee7-467d-9d48-355070896e17 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:53.309162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 107/229] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:53.313584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcdd18-fee7-467d-9d48-355070896e17 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:53.362835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485d63a-466e-46df-9f39-4c3a554d425c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:53.391299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:53.426313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954974a8-1532-4d60-95c2-9ebedcf6d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:53.428308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954974a8-1532-4d60-95c2-9ebedcf6d22a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:53.428596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954974a8-1532-4d60-95c2-9ebedcf6d22a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:53.428869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954974a8-1532-4d60-95c2-9ebedcf6d22a None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:53.430668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954974a8-1532-4d60-95c2-9ebedcf6d22a None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:53.432721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954974a8-1532-4d60-95c2-9ebedcf6d22a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:53.442407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 123/230] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:53 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:53.444779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954974a8-1532-4d60-95c2-9ebedcf6d22a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:53.491488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:53.513527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcdd18-fee7-467d-9d48-355070896e17 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:53.584548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954974a8-1532-4d60-95c2-9ebedcf6d22a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:53.590367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9475b45-90e8-44a5-927d-c90e842d4bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:53.591340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475b45-90e8-44a5-927d-c90e842d4bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:53.591619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475b45-90e8-44a5-927d-c90e842d4bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:53.591889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475b45-90e8-44a5-927d-c90e842d4bb5 None admin] PATH_INFO: `/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:53.595051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9475b45-90e8-44a5-927d-c90e842d4bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=3cbcd20b6eb24b18a2a321f24f36a00d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:53.596624 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9475b45-90e8-44a5-927d-c90e842d4bb5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:53.598730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 108/231] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:53 2022] GET /identity/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:53.604320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9475b45-90e8-44a5-927d-c90e842d4bb5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:53.632774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a9da-ec0f-4559-98da-2ecbc93e96d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:53.635776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a9da-ec0f-4559-98da-2ecbc93e96d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:53.636053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a9da-ec0f-4559-98da-2ecbc93e96d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:53.636323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a9da-ec0f-4559-98da-2ecbc93e96d5 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083/users/3cbcd20b6eb24b18a2a321f24f36a00d/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:53.645216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a9da-ec0f-4559-98da-2ecbc93e96d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdefa8d9129437abc74ff4d6d386083, user_id=3cbcd20b6eb24b18a2a321f24f36a00d, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:53.646726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a9da-ec0f-4559-98da-2ecbc93e96d5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:53.705367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 124/232] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:53 2022] PUT /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083/users/3cbcd20b6eb24b18a2a321f24f36a00d/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:53.734218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9475b45-90e8-44a5-927d-c90e842d4bb5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:53.749625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:53.785994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6c9e8-b0b4-4806-a4d6-41ac6cb2f9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:53.786884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6c9e8-b0b4-4806-a4d6-41ac6cb2f9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:53.787185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6c9e8-b0b4-4806-a4d6-41ac6cb2f9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:53.787543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6c9e8-b0b4-4806-a4d6-41ac6cb2f9f9 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:53.792064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6c9e8-b0b4-4806-a4d6-41ac6cb2f9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:53.793602 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6c9e8-b0b4-4806-a4d6-41ac6cb2f9f9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:53.795813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 109/233] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:53 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:53.801465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a9da-ec0f-4559-98da-2ecbc93e96d5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:53.914048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:53.934574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a9da-ec0f-4559-98da-2ecbc93e96d5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:53.971116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f9e88-014e-4da0-b902-59aa6cd21b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:53.972045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f9e88-014e-4da0-b902-59aa6cd21b01 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:53.972329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f9e88-014e-4da0-b902-59aa6cd21b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:53.972603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f9e88-014e-4da0-b902-59aa6cd21b01 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083/users/3cbcd20b6eb24b18a2a321f24f36a00d/roles/cd5bf20507a2408d8f752cc0be80f77f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:53.974822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f9e88-014e-4da0-b902-59aa6cd21b01 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdefa8d9129437abc74ff4d6d386083, user_id=3cbcd20b6eb24b18a2a321f24f36a00d, role_id=cd5bf20507a2408d8f752cc0be80f77f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:53.976553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f9e88-014e-4da0-b902-59aa6cd21b01 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:54.094524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 125/234] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:53 2022] PUT /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083/users/3cbcd20b6eb24b18a2a321f24f36a00d/roles/cd5bf20507a2408d8f752cc0be80f77f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:54.895800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f510ab-c925-477f-8b26-3e3e648c2b1b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:54.896311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f510ab-c925-477f-8b26-3e3e648c2b1b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:54.896386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f510ab-c925-477f-8b26-3e3e648c2b1b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:54.897968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 110/235] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:54.902984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb78558-1da4-440e-89f7-749d4981d641 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:54.903817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb78558-1da4-440e-89f7-749d4981d641 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:54.904315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb78558-1da4-440e-89f7-749d4981d641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:54.926149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bdb78558-1da4-440e-89f7-749d4981d641 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:54.927668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bdb78558-1da4-440e-89f7-749d4981d641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:54.949258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a86ebd-f6e0-461b-b491-389d88392206 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:54.949258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a86ebd-f6e0-461b-b491-389d88392206 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:54.949258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a86ebd-f6e0-461b-b491-389d88392206 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:54.949258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 111/236] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:54.955027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f57bd-bc65-47a4-9db1-c95522826e52 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:54.955612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f57bd-bc65-47a4-9db1-c95522826e52 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:54.956596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f57bd-bc65-47a4-9db1-c95522826e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:54.974133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-991f57bd-bc65-47a4-9db1-c95522826e52 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:54.976021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-991f57bd-bc65-47a4-9db1-c95522826e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:55.045481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 112/237] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:55.051272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 126/238] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:55.071463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb78558-1da4-440e-89f7-749d4981d641 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.088578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f57bd-bc65-47a4-9db1-c95522826e52 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.194987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f57bd-bc65-47a4-9db1-c95522826e52 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.203460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:55.229255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:55.237274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04232968-2f79-44a4-ab20-0f62021bf11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.238426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04232968-2f79-44a4-ab20-0f62021bf11e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.238929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04232968-2f79-44a4-ab20-0f62021bf11e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.239410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04232968-2f79-44a4-ab20-0f62021bf11e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.263881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04232968-2f79-44a4-ab20-0f62021bf11e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-04232968-2f79-44a4-ab20-0f62021bf11e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:55.277321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:55.278231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:55.279012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:55.279632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 113/239] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:55.287133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04232968-2f79-44a4-ab20-0f62021bf11e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.301364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb78558-1da4-440e-89f7-749d4981d641 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.345649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f458f2-1e6b-4081-8d0f-228e0ffecbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.346510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f458f2-1e6b-4081-8d0f-228e0ffecbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.346829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f458f2-1e6b-4081-8d0f-228e0ffecbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.347117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f458f2-1e6b-4081-8d0f-228e0ffecbf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.348450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f458f2-1e6b-4081-8d0f-228e0ffecbf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:55.349906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f458f2-1e6b-4081-8d0f-228e0ffecbf5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:55.351982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 127/240] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:55.359420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f458f2-1e6b-4081-8d0f-228e0ffecbf5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.456518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04232968-2f79-44a4-ab20-0f62021bf11e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.490111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f458f2-1e6b-4081-8d0f-228e0ffecbf5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.492924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03278-2969-4a69-bae3-d7a55c5d7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.493698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03278-2969-4a69-bae3-d7a55c5d7172 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.494081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03278-2969-4a69-bae3-d7a55c5d7172 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.494452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03278-2969-4a69-bae3-d7a55c5d7172 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.495332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03278-2969-4a69-bae3-d7a55c5d7172 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:55.495756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03278-2969-4a69-bae3-d7a55c5d7172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:55.497231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03278-2969-4a69-bae3-d7a55c5d7172 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:55.508686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 114/241] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:55.510159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978870e-9726-4cfa-879e-81db7763f0c9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.510593 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978870e-9726-4cfa-879e-81db7763f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.511009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978870e-9726-4cfa-879e-81db7763f0c9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.516768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 115/242] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:55.517569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978870e-9726-4cfa-879e-81db7763f0c9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.529436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88a6b-b33e-47fa-82bc-8c89ca76146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.530816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88a6b-b33e-47fa-82bc-8c89ca76146c None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.531613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88a6b-b33e-47fa-82bc-8c89ca76146c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.532111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88a6b-b33e-47fa-82bc-8c89ca76146c None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.533284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a88a6b-b33e-47fa-82bc-8c89ca76146c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:55.535837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a88a6b-b33e-47fa-82bc-8c89ca76146c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:55.546684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:55.548357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:55.620577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978870e-9726-4cfa-879e-81db7763f0c9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.654797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 128/243] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:55 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:55.656738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b318-629d-40b3-b52c-ca2fdad9b572 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.657521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b318-629d-40b3-b52c-ca2fdad9b572 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.658054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b318-629d-40b3-b52c-ca2fdad9b572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.667540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb6ba-3706-4238-91a3-669d572038b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.668124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb6ba-3706-4238-91a3-669d572038b7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.668411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb6ba-3706-4238-91a3-669d572038b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.668680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb6ba-3706-4238-91a3-669d572038b7 None admin] PATH_INFO: `/v3/users/841ade7770f24d1e8c8307e3845d7546` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.683050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f119b318-629d-40b3-b52c-ca2fdad9b572 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:55.685066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f119b318-629d-40b3-b52c-ca2fdad9b572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:55.689075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eb6ba-3706-4238-91a3-669d572038b7 None admin] RBAC: Authorizing `identity:get_user(user_id=841ade7770f24d1e8c8307e3845d7546)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:55.689075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eb6ba-3706-4238-91a3-669d572038b7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:55.689075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 116/244] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/users/841ade7770f24d1e8c8307e3845d7546 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:55.695170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb6ba-3706-4238-91a3-669d572038b7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.775074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 129/245] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:55.819897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b318-629d-40b3-b52c-ca2fdad9b572 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.869288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:55.901189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb6ba-3706-4238-91a3-669d572038b7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.976245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0df30-e24d-44ae-994f-3a4c049b2919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.977263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0df30-e24d-44ae-994f-3a4c049b2919 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.977791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0df30-e24d-44ae-994f-3a4c049b2919 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.978265 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0df30-e24d-44ae-994f-3a4c049b2919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.989409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b318-629d-40b3-b52c-ca2fdad9b572 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.015654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.039539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaa4b9-7777-40e7-86f4-7af581a3ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.047781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaa4b9-7777-40e7-86f4-7af581a3ba13 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.047781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaa4b9-7777-40e7-86f4-7af581a3ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.047781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaa4b9-7777-40e7-86f4-7af581a3ba13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.056516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaa4b9-7777-40e7-86f4-7af581a3ba13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:56.061241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0df30-e24d-44ae-994f-3a4c049b2919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.062982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0df30-e24d-44ae-994f-3a4c049b2919 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6baaa4b9-7777-40e7-86f4-7af581a3ba13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:56.065731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:56.066629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:56.067494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 130/246] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:56.074198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaa4b9-7777-40e7-86f4-7af581a3ba13 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.182465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.192920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaa4b9-7777-40e7-86f4-7af581a3ba13 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.201624 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 117/247] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:56.212149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0df30-e24d-44ae-994f-3a4c049b2919 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.241668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af9ea5-da39-48c5-a0cd-2faaf885449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.241966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af9ea5-da39-48c5-a0cd-2faaf885449e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.246212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af9ea5-da39-48c5-a0cd-2faaf885449e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.246212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af9ea5-da39-48c5-a0cd-2faaf885449e None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.246212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af9ea5-da39-48c5-a0cd-2faaf885449e None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:56.246212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af9ea5-da39-48c5-a0cd-2faaf885449e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.246212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af9ea5-da39-48c5-a0cd-2faaf885449e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.261926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 131/248] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:56.271724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af9ea5-da39-48c5-a0cd-2faaf885449e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.339142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.354447 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0df30-e24d-44ae-994f-3a4c049b2919 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.399129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96deb-3589-40f5-b462-ad1d83b80a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.400015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96deb-3589-40f5-b462-ad1d83b80a46 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.400293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96deb-3589-40f5-b462-ad1d83b80a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.400568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96deb-3589-40f5-b462-ad1d83b80a46 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.402526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e96deb-3589-40f5-b462-ad1d83b80a46 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.404043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e96deb-3589-40f5-b462-ad1d83b80a46 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.406369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 118/249] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:56.412665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96deb-3589-40f5-b462-ad1d83b80a46 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.423943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af9ea5-da39-48c5-a0cd-2faaf885449e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.466686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e44c9f-dbf2-45d5-a810-29f29449d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.467691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e44c9f-dbf2-45d5-a810-29f29449d85f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.468035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e44c9f-dbf2-45d5-a810-29f29449d85f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.468373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e44c9f-dbf2-45d5-a810-29f29449d85f None admin] PATH_INFO: `/v3/users/50793af1fd6341e28794c7bb481bbc40` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.469736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e44c9f-dbf2-45d5-a810-29f29449d85f None admin] RBAC: Authorizing `identity:get_user(user_id=50793af1fd6341e28794c7bb481bbc40)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.471307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e44c9f-dbf2-45d5-a810-29f29449d85f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.474093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 132/250] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/users/50793af1fd6341e28794c7bb481bbc40 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:56.480015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e44c9f-dbf2-45d5-a810-29f29449d85f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.484194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.548248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96deb-3589-40f5-b462-ad1d83b80a46 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.616607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36290240-21c2-4008-b6f9-987e50523032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.617502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36290240-21c2-4008-b6f9-987e50523032 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.618503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36290240-21c2-4008-b6f9-987e50523032 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.618984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36290240-21c2-4008-b6f9-987e50523032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.620093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36290240-21c2-4008-b6f9-987e50523032 None admin] RBAC: Adding query filter params (role.id=61c5b1b2390148b883b9a95a739b6736, scope.project.id=fcdefa8d9129437abc74ff4d6d386083, user.id=841ade7770f24d1e8c8307e3845d7546) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:56.621169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36290240-21c2-4008-b6f9-987e50523032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.622900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36290240-21c2-4008-b6f9-987e50523032 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.635643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e44c9f-dbf2-45d5-a810-29f29449d85f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.637613 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 119/251] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/role_assignments?user.id=841ade7770f24d1e8c8307e3845d7546&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=61c5b1b2390148b883b9a95a739b6736 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:56.639410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ece3-f7b5-40c2-9fc9-b8685321a85a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.640647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ece3-f7b5-40c2-9fc9-b8685321a85a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.641088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ece3-f7b5-40c2-9fc9-b8685321a85a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.647442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 120/252] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:56.649109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81b403-9144-42e4-9fa9-f9035bb32679 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.649539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81b403-9144-42e4-9fa9-f9035bb32679 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.649948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81b403-9144-42e4-9fa9-f9035bb32679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.668397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.681744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3a81b403-9144-42e4-9fa9-f9035bb32679 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:56.684226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3a81b403-9144-42e4-9fa9-f9035bb32679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:56.709416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2523fbc-09fb-4db8-9297-c8a86ece984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.710759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2523fbc-09fb-4db8-9297-c8a86ece984b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.712101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2523fbc-09fb-4db8-9297-c8a86ece984b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.713326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2523fbc-09fb-4db8-9297-c8a86ece984b None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.714949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2523fbc-09fb-4db8-9297-c8a86ece984b None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.717779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2523fbc-09fb-4db8-9297-c8a86ece984b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.719904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 133/253] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:56.726063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2523fbc-09fb-4db8-9297-c8a86ece984b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.837870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2523fbc-09fb-4db8-9297-c8a86ece984b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.840117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 121/254] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:56.877295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f30a44-6b68-4344-b994-0c0a105c07f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.878934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30a44-6b68-4344-b994-0c0a105c07f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.879066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81b403-9144-42e4-9fa9-f9035bb32679 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.879495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30a44-6b68-4344-b994-0c0a105c07f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.879908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30a44-6b68-4344-b994-0c0a105c07f7 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083/users/50793af1fd6341e28794c7bb481bbc40/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.882305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f30a44-6b68-4344-b994-0c0a105c07f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdefa8d9129437abc74ff4d6d386083, user_id=50793af1fd6341e28794c7bb481bbc40, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.883956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f30a44-6b68-4344-b994-0c0a105c07f7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.957298 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.984443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 134/255] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:56 2022] PUT /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083/users/50793af1fd6341e28794c7bb481bbc40/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:57.022324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81b403-9144-42e4-9fa9-f9035bb32679 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.061116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb0624-bd28-447f-bcf1-c3a2cc9b537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.061530 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de831d-45ac-4ad6-bbc4-2cb07d021acb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.061962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb0624-bd28-447f-bcf1-c3a2cc9b537a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.062244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb0624-bd28-447f-bcf1-c3a2cc9b537a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.062520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb0624-bd28-447f-bcf1-c3a2cc9b537a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.062879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de831d-45ac-4ad6-bbc4-2cb07d021acb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.063388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de831d-45ac-4ad6-bbc4-2cb07d021acb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.070066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 135/256] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:57.072284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853354ff-ae43-4f2d-ae6b-9d859ac89d35 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.072768 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853354ff-ae43-4f2d-ae6b-9d859ac89d35 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.073289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853354ff-ae43-4f2d-ae6b-9d859ac89d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.080094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb0624-bd28-447f-bcf1-c3a2cc9b537a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b0fb0624-bd28-447f-bcf1-c3a2cc9b537a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:57.089571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:57.090498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:53:57.091748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 122/257] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:57.094168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-853354ff-ae43-4f2d-ae6b-9d859ac89d35 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:57.095661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-853354ff-ae43-4f2d-ae6b-9d859ac89d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:57.096657 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb0624-bd28-447f-bcf1-c3a2cc9b537a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.137812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.172195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 136/258] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:57.198206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853354ff-ae43-4f2d-ae6b-9d859ac89d35 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.285953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb0624-bd28-447f-bcf1-c3a2cc9b537a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.302440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.310787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853354ff-ae43-4f2d-ae6b-9d859ac89d35 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.348560 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fc28c-1831-490d-bd9e-05fa3f96ae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.349816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fc28c-1831-490d-bd9e-05fa3f96ae07 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.350554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fc28c-1831-490d-bd9e-05fa3f96ae07 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.351014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fc28c-1831-490d-bd9e-05fa3f96ae07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.360430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b0b32-e604-4e72-b744-3c55772baba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.361135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b0b32-e604-4e72-b744-3c55772baba3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.361421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b0b32-e604-4e72-b744-3c55772baba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.361698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b0b32-e604-4e72-b744-3c55772baba3 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.363035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b0b32-e604-4e72-b744-3c55772baba3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:57.363370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b0b32-e604-4e72-b744-3c55772baba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.364816 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b0b32-e604-4e72-b744-3c55772baba3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.365425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fc28c-1831-490d-bd9e-05fa3f96ae07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-629fc28c-1831-490d-bd9e-05fa3f96ae07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:57.373925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:57.374816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:57.375610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:57.382808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 123/260] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.383158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 137/260] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:57.384672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b0b32-e604-4e72-b744-3c55772baba3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.388492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fc28c-1831-490d-bd9e-05fa3f96ae07 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.430180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.559267 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fc28c-1831-490d-bd9e-05fa3f96ae07 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.575496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b0b32-e604-4e72-b744-3c55772baba3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.615636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e36ccb-7656-43ad-a05d-e831a5a195f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.616522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e36ccb-7656-43ad-a05d-e831a5a195f4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.616841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e36ccb-7656-43ad-a05d-e831a5a195f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.617255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e36ccb-7656-43ad-a05d-e831a5a195f4 None admin] PATH_INFO: `/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.623116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e36ccb-7656-43ad-a05d-e831a5a195f4 None admin] RBAC: Authorizing `identity:get_user(user_id=3cbcd20b6eb24b18a2a321f24f36a00d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.623116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e36ccb-7656-43ad-a05d-e831a5a195f4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.623294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 138/261] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.628879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e36ccb-7656-43ad-a05d-e831a5a195f4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.644428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e66657-6954-4854-bbae-29bcfb6bb976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.645039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e66657-6954-4854-bbae-29bcfb6bb976 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.645318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e66657-6954-4854-bbae-29bcfb6bb976 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.645588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e66657-6954-4854-bbae-29bcfb6bb976 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.646343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e66657-6954-4854-bbae-29bcfb6bb976 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:57.646647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e66657-6954-4854-bbae-29bcfb6bb976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.648049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e66657-6954-4854-bbae-29bcfb6bb976 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.662701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 124/262] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.668563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e66657-6954-4854-bbae-29bcfb6bb976 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.734375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e36ccb-7656-43ad-a05d-e831a5a195f4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.735948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.753414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.769998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98377a4-65ea-421b-80e9-1c2c07b02c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.770763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98377a4-65ea-421b-80e9-1c2c07b02c3e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.771141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98377a4-65ea-421b-80e9-1c2c07b02c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.771499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98377a4-65ea-421b-80e9-1c2c07b02c3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.848504 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98377a4-65ea-421b-80e9-1c2c07b02c3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.850398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98377a4-65ea-421b-80e9-1c2c07b02c3e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.888916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e66657-6954-4854-bbae-29bcfb6bb976 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.957264 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.960405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 139/263] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:57.965854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98377a4-65ea-421b-80e9-1c2c07b02c3e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.983792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6ad28-89b9-40f5-8ebe-c664a4f7520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.984678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6ad28-89b9-40f5-8ebe-c664a4f7520f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.984957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6ad28-89b9-40f5-8ebe-c664a4f7520f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.985264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6ad28-89b9-40f5-8ebe-c664a4f7520f None admin] PATH_INFO: `/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.986468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6ad28-89b9-40f5-8ebe-c664a4f7520f None admin] RBAC: Authorizing `identity:get_user(user_id=3cbcd20b6eb24b18a2a321f24f36a00d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.988698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6ad28-89b9-40f5-8ebe-c664a4f7520f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.991296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 125/264] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/users/3cbcd20b6eb24b18a2a321f24f36a00d => generated 283 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.996785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6ad28-89b9-40f5-8ebe-c664a4f7520f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.085897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98377a4-65ea-421b-80e9-1c2c07b02c3e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.132130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc787f78-8ca5-4dcf-8320-8253a3b08f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.133373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc787f78-8ca5-4dcf-8320-8253a3b08f22 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.133858 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc787f78-8ca5-4dcf-8320-8253a3b08f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.134347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc787f78-8ca5-4dcf-8320-8253a3b08f22 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.135767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc787f78-8ca5-4dcf-8320-8253a3b08f22 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.137486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc787f78-8ca5-4dcf-8320-8253a3b08f22 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:58.140130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 140/265] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:58.148105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc787f78-8ca5-4dcf-8320-8253a3b08f22 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.276376 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.280595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc787f78-8ca5-4dcf-8320-8253a3b08f22 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.283673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.288954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6ad28-89b9-40f5-8ebe-c664a4f7520f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.316036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c7ecc-0d9f-4008-828c-002c349bd0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.317180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c7ecc-0d9f-4008-828c-002c349bd0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.317618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c7ecc-0d9f-4008-828c-002c349bd0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.318067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c7ecc-0d9f-4008-828c-002c349bd0c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.319288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c7ecc-0d9f-4008-828c-002c349bd0c6 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=fcdefa8d9129437abc74ff4d6d386083, user.id=3cbcd20b6eb24b18a2a321f24f36a00d) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:58.319760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c7ecc-0d9f-4008-828c-002c349bd0c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.321478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c7ecc-0d9f-4008-828c-002c349bd0c6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:58.327896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 141/266] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:58 2022] GET /identity/v3/role_assignments?user.id=3cbcd20b6eb24b18a2a321f24f36a00d&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:58.377428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d149d85-ca7b-4697-a594-95faeec79b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.378153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d149d85-ca7b-4697-a594-95faeec79b69 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.378435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d149d85-ca7b-4697-a594-95faeec79b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.378709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d149d85-ca7b-4697-a594-95faeec79b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.493350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d149d85-ca7b-4697-a594-95faeec79b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.494839 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d149d85-ca7b-4697-a594-95faeec79b69 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:58.719454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.733971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 126/267] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:58.739334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c7ecc-0d9f-4008-828c-002c349bd0c6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.859112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c7ecc-0d9f-4008-828c-002c349bd0c6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.895503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.901238 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92fc29-a75f-46ed-9be2-a30809f152e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.902454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92fc29-a75f-46ed-9be2-a30809f152e3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.902926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92fc29-a75f-46ed-9be2-a30809f152e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.903432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92fc29-a75f-46ed-9be2-a30809f152e3 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.905066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92fc29-a75f-46ed-9be2-a30809f152e3 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.906995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92fc29-a75f-46ed-9be2-a30809f152e3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:58.910141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 142/268] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:58 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:58.915859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d149d85-ca7b-4697-a594-95faeec79b69 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.035789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d149d85-ca7b-4697-a594-95faeec79b69 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.080778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3722d0b-8b14-4100-9a98-00e0efc8b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.081822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722d0b-8b14-4100-9a98-00e0efc8b35b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.082302 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722d0b-8b14-4100-9a98-00e0efc8b35b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.082764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722d0b-8b14-4100-9a98-00e0efc8b35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.083806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3722d0b-8b14-4100-9a98-00e0efc8b35b None admin] RBAC: Adding query filter params (role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=fcdefa8d9129437abc74ff4d6d386083, user.id=3cbcd20b6eb24b18a2a321f24f36a00d) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:59.084312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3722d0b-8b14-4100-9a98-00e0efc8b35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:59.085997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3722d0b-8b14-4100-9a98-00e0efc8b35b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.095632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 127/269] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:58 2022] GET /identity/v3/role_assignments?user.id=3cbcd20b6eb24b18a2a321f24f36a00d&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:59.243701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e788-5df9-4465-b7fc-9c4327c9a63a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.244217 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e788-5df9-4465-b7fc-9c4327c9a63a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.244217 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e788-5df9-4465-b7fc-9c4327c9a63a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.245730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 143/270] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:59.251191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785681-78a5-46c0-bf26-8975fdbace2c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.251482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785681-78a5-46c0-bf26-8975fdbace2c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.251755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785681-78a5-46c0-bf26-8975fdbace2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.274273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-94785681-78a5-46c0-bf26-8975fdbace2c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:59.275499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-94785681-78a5-46c0-bf26-8975fdbace2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:59.365166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:59.377682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 128/271] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:59.410450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4e788-5df9-4465-b7fc-9c4327c9a63a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.525798 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4e788-5df9-4465-b7fc-9c4327c9a63a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.561673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c55cc-6766-4f40-9f3e-a117b15b8eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.562462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c55cc-6766-4f40-9f3e-a117b15b8eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.562737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c55cc-6766-4f40-9f3e-a117b15b8eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.563006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c55cc-6766-4f40-9f3e-a117b15b8eb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.574447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c55cc-6766-4f40-9f3e-a117b15b8eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-875c55cc-6766-4f40-9f3e-a117b15b8eb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:59.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:59.583754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:53:59.584543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 144/272] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:59.591258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785681-78a5-46c0-bf26-8975fdbace2c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.712097 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785681-78a5-46c0-bf26-8975fdbace2c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.719647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc061b-218f-41ee-b3c5-ad920b19a1ad None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.719932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc061b-218f-41ee-b3c5-ad920b19a1ad None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.720204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc061b-218f-41ee-b3c5-ad920b19a1ad None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.721629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 145/273] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:59.728464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556adaa-e14c-47c3-80e7-8ed54cd02a0a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.728747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556adaa-e14c-47c3-80e7-8ed54cd02a0a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.729020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556adaa-e14c-47c3-80e7-8ed54cd02a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.750702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a556adaa-e14c-47c3-80e7-8ed54cd02a0a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:59.753128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a556adaa-e14c-47c3-80e7-8ed54cd02a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:59.759323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ed3e-ec01-4d4b-83c0-bd627f41b645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.760012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ed3e-ec01-4d4b-83c0-bd627f41b645 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.760289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ed3e-ec01-4d4b-83c0-bd627f41b645 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.760555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ed3e-ec01-4d4b-83c0-bd627f41b645 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.761364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7ed3e-ec01-4d4b-83c0-bd627f41b645 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:59.761666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7ed3e-ec01-4d4b-83c0-bd627f41b645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:59.763533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7ed3e-ec01-4d4b-83c0-bd627f41b645 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.780736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 129/274] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:59.786233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ed3e-ec01-4d4b-83c0-bd627f41b645 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.838044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:59.840224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 146/275] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:59.851768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:59.865007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556adaa-e14c-47c3-80e7-8ed54cd02a0a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.900949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ed3e-ec01-4d4b-83c0-bd627f41b645 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.937422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0b4b1-9304-4092-bf58-9b51cf0e8138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.938464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0b4b1-9304-4092-bf58-9b51cf0e8138 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.938739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0b4b1-9304-4092-bf58-9b51cf0e8138 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.939007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0b4b1-9304-4092-bf58-9b51cf0e8138 None admin] PATH_INFO: `/v3/users/576102374ad74fe2923134c3b00e3766` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.960157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0b4b1-9304-4092-bf58-9b51cf0e8138 None admin] RBAC: Authorizing `identity:get_user(user_id=576102374ad74fe2923134c3b00e3766)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:59.962387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0b4b1-9304-4092-bf58-9b51cf0e8138 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.964822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 130/276] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/users/576102374ad74fe2923134c3b00e3766 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:59.966075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4f8db-6ac0-4a8f-ac3f-3fc3f4ee372d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.966353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4f8db-6ac0-4a8f-ac3f-3fc3f4ee372d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.966621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4f8db-6ac0-4a8f-ac3f-3fc3f4ee372d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.968013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 131/277] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:59.973694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4f8db-6ac0-4a8f-ac3f-3fc3f4ee372d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.978376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556adaa-e14c-47c3-80e7-8ed54cd02a0a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.015999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54859e-005b-4e3b-9006-9cd22161aec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.016899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54859e-005b-4e3b-9006-9cd22161aec4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.017176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54859e-005b-4e3b-9006-9cd22161aec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.017446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54859e-005b-4e3b-9006-9cd22161aec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.018851 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54859e-005b-4e3b-9006-9cd22161aec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:00.020306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54859e-005b-4e3b-9006-9cd22161aec4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:00.026633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 147/278] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:00.028218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6434-3b4a-43e5-b2c7-a2ba440d6417 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.028506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6434-3b4a-43e5-b2c7-a2ba440d6417 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.028779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6434-3b4a-43e5-b2c7-a2ba440d6417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.045784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-18ad6434-3b4a-43e5-b2c7-a2ba440d6417 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:00.047001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-18ad6434-3b4a-43e5-b2c7-a2ba440d6417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:00.074860 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4f8db-6ac0-4a8f-ac3f-3fc3f4ee372d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.089152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:00.106101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:00.110596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fbedd-1eb8-4bfa-ab77-429be875b305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.111283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbedd-1eb8-4bfa-ab77-429be875b305 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.111562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbedd-1eb8-4bfa-ab77-429be875b305 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.112361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbedd-1eb8-4bfa-ab77-429be875b305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.113180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fbedd-1eb8-4bfa-ab77-429be875b305 None admin] RBAC: Adding query filter params (role.id=e9661633951e4db5a9b85f9a3bdfe777, user.id=576102374ad74fe2923134c3b00e3766, scope.system=all) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:00.113615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fbedd-1eb8-4bfa-ab77-429be875b305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:00.114888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fbedd-1eb8-4bfa-ab77-429be875b305 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:00.128112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 132/279] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/role_assignments?user.id=576102374ad74fe2923134c3b00e3766&scope.system=all&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:00.128301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 148/280] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:00.128378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fbedd-1eb8-4bfa-ab77-429be875b305 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:00.143652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6434-3b4a-43e5-b2c7-a2ba440d6417 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:00.254995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fbedd-1eb8-4bfa-ab77-429be875b305 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.271435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6434-3b4a-43e5-b2c7-a2ba440d6417 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.296171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f94c1-c351-46bd-bae9-a9d1cae0c608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.296936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f94c1-c351-46bd-bae9-a9d1cae0c608 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.297216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f94c1-c351-46bd-bae9-a9d1cae0c608 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.297513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f94c1-c351-46bd-bae9-a9d1cae0c608 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.298213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f94c1-c351-46bd-bae9-a9d1cae0c608 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:00.300511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f94c1-c351-46bd-bae9-a9d1cae0c608 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:00.308076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b315e-b4b7-40cc-9cba-5788e4a860de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.308884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b315e-b4b7-40cc-9cba-5788e4a860de None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.309162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b315e-b4b7-40cc-9cba-5788e4a860de None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.309437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b315e-b4b7-40cc-9cba-5788e4a860de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.320861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b315e-b4b7-40cc-9cba-5788e4a860de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b88b315e-b4b7-40cc-9cba-5788e4a860de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:00.328571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:00.329618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:00.330476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 149/281] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:00.332110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde60e0-3b73-445f-a1b2-0d07246a06a7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.332110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde60e0-3b73-445f-a1b2-0d07246a06a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.332288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde60e0-3b73-445f-a1b2-0d07246a06a7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.335124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 150/282] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:00.335472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde60e0-3b73-445f-a1b2-0d07246a06a7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:00.385830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:00.427534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 133/283] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:00 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:00.429085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac38ec-3765-4b8a-99d4-694733ff70c4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.429373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac38ec-3765-4b8a-99d4-694733ff70c4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.429655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac38ec-3765-4b8a-99d4-694733ff70c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.438380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde60e0-3b73-445f-a1b2-0d07246a06a7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.476232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6bd6-4479-46b8-ae4b-9e75a9439899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.476911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6bd6-4479-46b8-ae4b-9e75a9439899 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.477189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6bd6-4479-46b8-ae4b-9e75a9439899 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.477459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6bd6-4479-46b8-ae4b-9e75a9439899 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.478245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea6bd6-4479-46b8-ae4b-9e75a9439899 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:00.478551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea6bd6-4479-46b8-ae4b-9e75a9439899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:00.479976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea6bd6-4479-46b8-ae4b-9e75a9439899 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:00.484243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-84ac38ec-3765-4b8a-99d4-694733ff70c4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:00.485452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-84ac38ec-3765-4b8a-99d4-694733ff70c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:00.490116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 151/284] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:00.499252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6bd6-4479-46b8-ae4b-9e75a9439899 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:00.527309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:00.574496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 134/285] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:00.605204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac38ec-3765-4b8a-99d4-694733ff70c4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:00.619650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6bd6-4479-46b8-ae4b-9e75a9439899 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.631906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:00.657842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fb9f8-33cb-4805-a30e-804434ac10ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.659453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fb9f8-33cb-4805-a30e-804434ac10ea None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.660057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fb9f8-33cb-4805-a30e-804434ac10ea None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.660171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fb9f8-33cb-4805-a30e-804434ac10ea None admin] PATH_INFO: `/v3/users/841ade7770f24d1e8c8307e3845d7546` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.661498 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fb9f8-33cb-4805-a30e-804434ac10ea None admin] RBAC: Authorizing `identity:get_user(user_id=841ade7770f24d1e8c8307e3845d7546)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:00.663233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fb9f8-33cb-4805-a30e-804434ac10ea None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:00.665586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 152/286] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:54:00 2022] GET /identity/v3/users/841ade7770f24d1e8c8307e3845d7546 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:00.670979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fb9f8-33cb-4805-a30e-804434ac10ea None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:00.723454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac38ec-3765-4b8a-99d4-694733ff70c4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.764436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b60a3-8015-4b6d-92be-d9b300412cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.765275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b60a3-8015-4b6d-92be-d9b300412cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.765555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b60a3-8015-4b6d-92be-d9b300412cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.765826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b60a3-8015-4b6d-92be-d9b300412cd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.778690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b60a3-8015-4b6d-92be-d9b300412cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:00.783564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fb9f8-33cb-4805-a30e-804434ac10ea None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-201b60a3-8015-4b6d-92be-d9b300412cd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:00.786954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:00.787899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:00.789081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 135/287] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:00.794021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b60a3-8015-4b6d-92be-d9b300412cd9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:00.822318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:00.827860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881a45-281f-4bbc-9d86-72cdb674a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.832243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881a45-281f-4bbc-9d86-72cdb674a83c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.832243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881a45-281f-4bbc-9d86-72cdb674a83c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.832243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881a45-281f-4bbc-9d86-72cdb674a83c None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.832243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f881a45-281f-4bbc-9d86-72cdb674a83c None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:00.832243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f881a45-281f-4bbc-9d86-72cdb674a83c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:00.833787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 153/288] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:00 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:00.839773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881a45-281f-4bbc-9d86-72cdb674a83c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:00.901057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:00.932445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b60a3-8015-4b6d-92be-d9b300412cd9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.970057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881a45-281f-4bbc-9d86-72cdb674a83c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.976062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f58c9-a065-4597-bd35-befb97ca6d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.976789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f58c9-a065-4597-bd35-befb97ca6d3f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.977072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f58c9-a065-4597-bd35-befb97ca6d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.977343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f58c9-a065-4597-bd35-befb97ca6d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.978530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f58c9-a065-4597-bd35-befb97ca6d3f None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:00.978844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f58c9-a065-4597-bd35-befb97ca6d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:00.980623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f58c9-a065-4597-bd35-befb97ca6d3f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:00.991667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 136/289] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:00.997743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f58c9-a065-4597-bd35-befb97ca6d3f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.014207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539b2ec-d77b-47a3-9316-09ec7c573938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.015443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539b2ec-d77b-47a3-9316-09ec7c573938 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.015724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539b2ec-d77b-47a3-9316-09ec7c573938 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.015993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539b2ec-d77b-47a3-9316-09ec7c573938 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083/users/841ade7770f24d1e8c8307e3845d7546/roles/61c5b1b2390148b883b9a95a739b6736` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.019506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539b2ec-d77b-47a3-9316-09ec7c573938 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdefa8d9129437abc74ff4d6d386083, user_id=841ade7770f24d1e8c8307e3845d7546, role_id=61c5b1b2390148b883b9a95a739b6736)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.021586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539b2ec-d77b-47a3-9316-09ec7c573938 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.097588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:01.113167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f58c9-a065-4597-bd35-befb97ca6d3f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.146642 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 154/290] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:00 2022] PUT /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083/users/841ade7770f24d1e8c8307e3845d7546/roles/61c5b1b2390148b883b9a95a739b6736 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:54:01.148600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b07fb0-99f5-4599-89c2-486eb29924a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.149474 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07fb0-99f5-4599-89c2-486eb29924a3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.149753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07fb0-99f5-4599-89c2-486eb29924a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.150078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07fb0-99f5-4599-89c2-486eb29924a3 None admin] PATH_INFO: `/v3/users/50793af1fd6341e28794c7bb481bbc40` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.151348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b07fb0-99f5-4599-89c2-486eb29924a3 None admin] RBAC: Authorizing `identity:get_user(user_id=50793af1fd6341e28794c7bb481bbc40)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.152891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b07fb0-99f5-4599-89c2-486eb29924a3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.155004 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 137/291] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:54:00 2022] GET /identity/v3/users/50793af1fd6341e28794c7bb481bbc40 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:01.160845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539b2ec-d77b-47a3-9316-09ec7c573938 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.279120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539b2ec-d77b-47a3-9316-09ec7c573938 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.286584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:01.316759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adce49-14ad-4a3e-aedb-46e5077119da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.317418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adce49-14ad-4a3e-aedb-46e5077119da None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.317699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adce49-14ad-4a3e-aedb-46e5077119da None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.317975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adce49-14ad-4a3e-aedb-46e5077119da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.406157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adce49-14ad-4a3e-aedb-46e5077119da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.407632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adce49-14ad-4a3e-aedb-46e5077119da None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.525392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 155/292] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:01.530831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b07fb0-99f5-4599-89c2-486eb29924a3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.643895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b07fb0-99f5-4599-89c2-486eb29924a3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.681192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4e3f9-9481-47c7-8966-a539abb13fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.681975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4e3f9-9481-47c7-8966-a539abb13fea None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.682251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4e3f9-9481-47c7-8966-a539abb13fea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.682520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4e3f9-9481-47c7-8966-a539abb13fea None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.683723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4e3f9-9481-47c7-8966-a539abb13fea None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.685178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4e3f9-9481-47c7-8966-a539abb13fea None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.687113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 138/293] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:01.692972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adce49-14ad-4a3e-aedb-46e5077119da None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.701543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:01.818262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adce49-14ad-4a3e-aedb-46e5077119da None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.858565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c3cc-eaf0-4f62-bc53-44e4b22a35c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.859253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c3cc-eaf0-4f62-bc53-44e4b22a35c7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.859538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c3cc-eaf0-4f62-bc53-44e4b22a35c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.859812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c3cc-eaf0-4f62-bc53-44e4b22a35c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.860651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c3cc-eaf0-4f62-bc53-44e4b22a35c7 None admin] RBAC: Adding query filter params (role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=fcdefa8d9129437abc74ff4d6d386083, user.id=50793af1fd6341e28794c7bb481bbc40) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:01.860960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c3cc-eaf0-4f62-bc53-44e4b22a35c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.862421 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c3cc-eaf0-4f62-bc53-44e4b22a35c7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.869019 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 156/294] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/role_assignments?user.id=50793af1fd6341e28794c7bb481bbc40&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:02.697806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71355385-1be8-45eb-a135-ae8c2680b952 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.698810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71355385-1be8-45eb-a135-ae8c2680b952 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.699328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71355385-1be8-45eb-a135-ae8c2680b952 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.700905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 139/295] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:02.706998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b985ef-b699-488f-ada2-c345c30d63ee None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.707908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b985ef-b699-488f-ada2-c345c30d63ee None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.708406 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b985ef-b699-488f-ada2-c345c30d63ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.726744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-04b985ef-b699-488f-ada2-c345c30d63ee None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:02.728014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-04b985ef-b699-488f-ada2-c345c30d63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:02.795853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:02.804500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 157/296] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:02.827446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71355385-1be8-45eb-a135-ae8c2680b952 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:02.856321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.007224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71355385-1be8-45eb-a135-ae8c2680b952 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.041840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a689b7-e237-4389-9664-ff31b2b39b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.042974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a689b7-e237-4389-9664-ff31b2b39b69 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.043493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a689b7-e237-4389-9664-ff31b2b39b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.043956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a689b7-e237-4389-9664-ff31b2b39b69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.054636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a689b7-e237-4389-9664-ff31b2b39b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a1a689b7-e237-4389-9664-ff31b2b39b69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:03.062643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:03.063560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:03.064328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:03.066801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 140/297] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:03.080911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b985ef-b699-488f-ada2-c345c30d63ee None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.189988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b985ef-b699-488f-ada2-c345c30d63ee None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.226091 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf52ab-25f8-4449-aa45-4d5eea53151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.226765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf52ab-25f8-4449-aa45-4d5eea53151e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.227050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf52ab-25f8-4449-aa45-4d5eea53151e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.227354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf52ab-25f8-4449-aa45-4d5eea53151e None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.228101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf52ab-25f8-4449-aa45-4d5eea53151e None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:03.228410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf52ab-25f8-4449-aa45-4d5eea53151e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.229774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf52ab-25f8-4449-aa45-4d5eea53151e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.238612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 158/298] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:03.240967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfc9b-1093-4253-a30c-f869d18e3368 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.241256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfc9b-1093-4253-a30c-f869d18e3368 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.241531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfc9b-1093-4253-a30c-f869d18e3368 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.243031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 141/299] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:03.244127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf52ab-25f8-4449-aa45-4d5eea53151e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.249331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc536cd-dd21-48ef-b796-ea3acc3cdd42 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.249850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc536cd-dd21-48ef-b796-ea3acc3cdd42 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.250320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc536cd-dd21-48ef-b796-ea3acc3cdd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.279189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5fc536cd-dd21-48ef-b796-ea3acc3cdd42 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:03.280675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5fc536cd-dd21-48ef-b796-ea3acc3cdd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:03.323130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.363135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 142/300] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:03.363135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9be6e3-f6bd-402c-9911-96659c0bc6dc None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.363377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf52ab-25f8-4449-aa45-4d5eea53151e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.363477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9be6e3-f6bd-402c-9911-96659c0bc6dc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.363477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9be6e3-f6bd-402c-9911-96659c0bc6dc None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.363477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 143/301] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:03.363477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5e331-e28a-4504-8731-212f71370c9f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.363477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5e331-e28a-4504-8731-212f71370c9f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.363477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5e331-e28a-4504-8731-212f71370c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.380806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5ee5e331-e28a-4504-8731-212f71370c9f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:03.381980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5ee5e331-e28a-4504-8731-212f71370c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:03.390034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.396582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753376d-20d4-4e4c-a1d0-d26396b1e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.397840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753376d-20d4-4e4c-a1d0-d26396b1e29a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.398017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753376d-20d4-4e4c-a1d0-d26396b1e29a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.398303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753376d-20d4-4e4c-a1d0-d26396b1e29a None admin] PATH_INFO: `/v3/users/576102374ad74fe2923134c3b00e3766` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.399528 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753376d-20d4-4e4c-a1d0-d26396b1e29a None admin] RBAC: Authorizing `identity:get_user(user_id=576102374ad74fe2923134c3b00e3766)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.400969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753376d-20d4-4e4c-a1d0-d26396b1e29a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.402966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 159/302] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/users/576102374ad74fe2923134c3b00e3766 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:03.408120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753376d-20d4-4e4c-a1d0-d26396b1e29a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.452023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 144/303] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:03.453137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5e331-e28a-4504-8731-212f71370c9f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.516332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753376d-20d4-4e4c-a1d0-d26396b1e29a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.546480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.552772 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8de3e8-0fc3-41bc-b6c0-30007da02b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.553592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8de3e8-0fc3-41bc-b6c0-30007da02b42 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.553875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8de3e8-0fc3-41bc-b6c0-30007da02b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.554149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8de3e8-0fc3-41bc-b6c0-30007da02b42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.567339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8de3e8-0fc3-41bc-b6c0-30007da02b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:03.569782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5e331-e28a-4504-8731-212f71370c9f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2d8de3e8-0fc3-41bc-b6c0-30007da02b42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:03.575519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:03.576643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:03.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:03.581087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 160/304] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:03.585892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8de3e8-0fc3-41bc-b6c0-30007da02b42 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.604947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9f51a-e49f-42ef-89bd-89b206b3ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.605819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9f51a-e49f-42ef-89bd-89b206b3ea0d None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.606103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9f51a-e49f-42ef-89bd-89b206b3ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.606377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9f51a-e49f-42ef-89bd-89b206b3ea0d None admin] PATH_INFO: `/v3/system/users/576102374ad74fe2923134c3b00e3766/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.607862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9f51a-e49f-42ef-89bd-89b206b3ea0d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=576102374ad74fe2923134c3b00e3766, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.609248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9f51a-e49f-42ef-89bd-89b206b3ea0d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.684932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8de3e8-0fc3-41bc-b6c0-30007da02b42 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.715142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 145/305] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Jun 2 09:54:03 2022] PUT /identity/v3/system/users/576102374ad74fe2923134c3b00e3766/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:03.718573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc03a-22cc-4c92-9fef-f0752d041ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.719415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc03a-22cc-4c92-9fef-f0752d041ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.719698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc03a-22cc-4c92-9fef-f0752d041ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.719966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dc03a-22cc-4c92-9fef-f0752d041ae1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.721231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dc03a-22cc-4c92-9fef-f0752d041ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.722711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dc03a-22cc-4c92-9fef-f0752d041ae1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.724107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9f51a-e49f-42ef-89bd-89b206b3ea0d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.729673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 161/306] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:03.730651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc03a-22cc-4c92-9fef-f0752d041ae1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.738510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.800106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.856127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dc03a-22cc-4c92-9fef-f0752d041ae1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.878583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9f51a-e49f-42ef-89bd-89b206b3ea0d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.905725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867f5c1-c0cd-4881-9849-5394e56f7801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.906664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867f5c1-c0cd-4881-9849-5394e56f7801 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.906938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867f5c1-c0cd-4881-9849-5394e56f7801 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.907244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867f5c1-c0cd-4881-9849-5394e56f7801 None admin] PATH_INFO: `/v3/groups` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.907933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867f5c1-c0cd-4881-9849-5394e56f7801 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.909374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867f5c1-c0cd-4881-9849-5394e56f7801 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.916087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e71c-3a17-48cd-a990-3ed7ae3304e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.916637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e71c-3a17-48cd-a990-3ed7ae3304e7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.916914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e71c-3a17-48cd-a990-3ed7ae3304e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.917182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e71c-3a17-48cd-a990-3ed7ae3304e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.918044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3e71c-3a17-48cd-a990-3ed7ae3304e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:03.918352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3e71c-3a17-48cd-a990-3ed7ae3304e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.919744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3e71c-3a17-48cd-a990-3ed7ae3304e7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.928975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 146/307] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:03.930262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7b79-5c5b-4ec3-8fc7-5f4c401895f9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.930543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7b79-5c5b-4ec3-8fc7-5f4c401895f9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.930812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7b79-5c5b-4ec3-8fc7-5f4c401895f9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.932312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 147/308] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:03.935261 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f7b79-5c5b-4ec3-8fc7-5f4c401895f9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.974757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 162/309] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Jun 2 09:54:03 2022] POST /identity/v3/groups => generated 229 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:03.976158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fc9b-a135-4a69-9bb8-3080d48cd692 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.976449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fc9b-a135-4a69-9bb8-3080d48cd692 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.976731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fc9b-a135-4a69-9bb8-3080d48cd692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.006337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e9e1fc9b-a135-4a69-9bb8-3080d48cd692 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:04.007810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e9e1fc9b-a135-4a69-9bb8-3080d48cd692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:04.011943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:04.050390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f7b79-5c5b-4ec3-8fc7-5f4c401895f9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:04.092839 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b16b-1570-481b-8b22-8312c0789622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:04.093838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b16b-1570-481b-8b22-8312c0789622 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.094192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b16b-1570-481b-8b22-8312c0789622 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.094538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b16b-1570-481b-8b22-8312c0789622 None admin] PATH_INFO: `/v3/users/f965d784d2e44fd2818ccc92eacb9a4b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.097995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 163/310] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:04.113148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7b16b-1570-481b-8b22-8312c0789622 None admin] RBAC: Authorizing `identity:get_user(user_id=f965d784d2e44fd2818ccc92eacb9a4b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:04.114780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7b16b-1570-481b-8b22-8312c0789622 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:04.117105 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 148/311] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/users/f965d784d2e44fd2818ccc92eacb9a4b => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:04.122708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fc9b-a135-4a69-9bb8-3080d48cd692 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:04.122929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b16b-1570-481b-8b22-8312c0789622 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:04.189811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:04.237832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b16b-1570-481b-8b22-8312c0789622 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:04.246224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fc9b-a135-4a69-9bb8-3080d48cd692 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:04.274125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:04.288511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb554e8-8bbd-4d80-871e-d0d8f7d40cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:04.289738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb554e8-8bbd-4d80-871e-d0d8f7d40cfa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.290322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb554e8-8bbd-4d80-871e-d0d8f7d40cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.290794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb554e8-8bbd-4d80-871e-d0d8f7d40cfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.291991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9328-4445-4a08-92be-880784fbddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:04.292263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb554e8-8bbd-4d80-871e-d0d8f7d40cfa None admin] RBAC: Adding query filter params (role.id=61c5b1b2390148b883b9a95a739b6736, user.id=f965d784d2e44fd2818ccc92eacb9a4b, scope.system=all) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:04.292783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9328-4445-4a08-92be-880784fbddd0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.292889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb554e8-8bbd-4d80-871e-d0d8f7d40cfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:04.293060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9328-4445-4a08-92be-880784fbddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.293324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9328-4445-4a08-92be-880784fbddd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.295244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb554e8-8bbd-4d80-871e-d0d8f7d40cfa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:04.303713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 149/312] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 2 09:54:04 2022] GET /identity/v3/role_assignments?user.id=f965d784d2e44fd2818ccc92eacb9a4b&scope.system=all&role.id=61c5b1b2390148b883b9a95a739b6736 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:04.310966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9328-4445-4a08-92be-880784fbddd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e80b9328-4445-4a08-92be-880784fbddd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:04.316216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:04.317132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:04.317944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 164/313] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:04.323401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb554e8-8bbd-4d80-871e-d0d8f7d40cfa None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:04.437369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb554e8-8bbd-4d80-871e-d0d8f7d40cfa None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:04.484083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea0697-05e6-4f25-9adb-dde5a5979d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:04.485171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea0697-05e6-4f25-9adb-dde5a5979d3e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.485632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea0697-05e6-4f25-9adb-dde5a5979d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.486108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea0697-05e6-4f25-9adb-dde5a5979d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.487609 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea0697-05e6-4f25-9adb-dde5a5979d3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:04.488119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea0697-05e6-4f25-9adb-dde5a5979d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:04.489682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea0697-05e6-4f25-9adb-dde5a5979d3e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:04.499668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 150/314] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:04.506033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9328-4445-4a08-92be-880784fbddd0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:04.613565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9328-4445-4a08-92be-880784fbddd0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:04.622547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:04.647486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845d1bd-572f-4a24-ba93-bc8fdff0bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:04.648360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845d1bd-572f-4a24-ba93-bc8fdff0bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.648637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845d1bd-572f-4a24-ba93-bc8fdff0bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.648911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845d1bd-572f-4a24-ba93-bc8fdff0bfc8 None admin] PATH_INFO: `/v3/users/841ade7770f24d1e8c8307e3845d7546` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.650126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845d1bd-572f-4a24-ba93-bc8fdff0bfc8 None admin] RBAC: Authorizing `identity:get_user(user_id=841ade7770f24d1e8c8307e3845d7546)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:04.651620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845d1bd-572f-4a24-ba93-bc8fdff0bfc8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:04.653579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 165/315] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:54:04 2022] GET /identity/v3/users/841ade7770f24d1e8c8307e3845d7546 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:04.658911 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea0697-05e6-4f25-9adb-dde5a5979d3e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:04.715479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:04.765389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea0697-05e6-4f25-9adb-dde5a5979d3e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:04.800686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc181-7c9a-482c-be51-4a8d14fb1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:04.801676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc181-7c9a-482c-be51-4a8d14fb1ccf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.802170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc181-7c9a-482c-be51-4a8d14fb1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.802664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc181-7c9a-482c-be51-4a8d14fb1ccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.876384 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dc181-7c9a-482c-be51-4a8d14fb1ccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:04.878337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dc181-7c9a-482c-be51-4a8d14fb1ccf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:04.937129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:04.988334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 151/316] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:04.994182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845d1bd-572f-4a24-ba93-bc8fdff0bfc8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.094518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845d1bd-572f-4a24-ba93-bc8fdff0bfc8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:05.129669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5be79-ad0d-4948-9b7e-2ed045de8022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:05.130455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5be79-ad0d-4948-9b7e-2ed045de8022 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.130734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5be79-ad0d-4948-9b7e-2ed045de8022 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.131005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5be79-ad0d-4948-9b7e-2ed045de8022 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.132215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5be79-ad0d-4948-9b7e-2ed045de8022 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:05.133631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5be79-ad0d-4948-9b7e-2ed045de8022 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:05.139196 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 166/317] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:04 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:05.141435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc181-7c9a-482c-be51-4a8d14fb1ccf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.243721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc181-7c9a-482c-be51-4a8d14fb1ccf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:05.278026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd370d-63b9-491d-8ff3-2a2680312f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:05.278680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd370d-63b9-491d-8ff3-2a2680312f1c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.278958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd370d-63b9-491d-8ff3-2a2680312f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.279256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd370d-63b9-491d-8ff3-2a2680312f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.280079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd370d-63b9-491d-8ff3-2a2680312f1c None admin] RBAC: Adding query filter params (role.id=61c5b1b2390148b883b9a95a739b6736, scope.project.id=fcdefa8d9129437abc74ff4d6d386083, user.id=841ade7770f24d1e8c8307e3845d7546) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:05.280383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd370d-63b9-491d-8ff3-2a2680312f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:05.281794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd370d-63b9-491d-8ff3-2a2680312f1c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:05.288560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 152/318] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:05 2022] GET /identity/v3/role_assignments?user.id=841ade7770f24d1e8c8307e3845d7546&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=61c5b1b2390148b883b9a95a739b6736 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:06.049112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed519-55f1-4f17-95e2-c5359c2da6c0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.049663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed519-55f1-4f17-95e2-c5359c2da6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.049745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed519-55f1-4f17-95e2-c5359c2da6c0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.051199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 167/319] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:06.058918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaf6c6-2d81-4d07-a42b-46cc6b7c85a6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.059472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaf6c6-2d81-4d07-a42b-46cc6b7c85a6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.059545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedaf6c6-2d81-4d07-a42b-46cc6b7c85a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.076254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-eedaf6c6-2d81-4d07-a42b-46cc6b7c85a6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:06.077503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-eedaf6c6-2d81-4d07-a42b-46cc6b7c85a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:06.088880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.147406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 153/320] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:06.171057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed519-55f1-4f17-95e2-c5359c2da6c0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.220062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.278165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed519-55f1-4f17-95e2-c5359c2da6c0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.316903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57643740-eeb0-4a75-88d5-9f8824e2b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.317621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643740-eeb0-4a75-88d5-9f8824e2b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.317903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643740-eeb0-4a75-88d5-9f8824e2b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.318178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643740-eeb0-4a75-88d5-9f8824e2b6a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.328659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57643740-eeb0-4a75-88d5-9f8824e2b6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-57643740-eeb0-4a75-88d5-9f8824e2b6a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:06.336879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:06.337733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:06.343303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 168/321] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:06.345522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedaf6c6-2d81-4d07-a42b-46cc6b7c85a6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.368983 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d477d9-99e4-4791-b7ae-30e8f47ae36d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.369299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d477d9-99e4-4791-b7ae-30e8f47ae36d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.369554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d477d9-99e4-4791-b7ae-30e8f47ae36d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.371260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 169/322] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:06.376007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251fcb-0c23-43c4-a6f9-8add84658d8b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.376295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251fcb-0c23-43c4-a6f9-8add84658d8b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.376573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251fcb-0c23-43c4-a6f9-8add84658d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.394400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-11251fcb-0c23-43c4-a6f9-8add84658d8b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:06.395625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-11251fcb-0c23-43c4-a6f9-8add84658d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:06.454371 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedaf6c6-2d81-4d07-a42b-46cc6b7c85a6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.475467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 170/323] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:06.491886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19e5eb-24b3-44e7-b325-361c56bd2118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.492560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19e5eb-24b3-44e7-b325-361c56bd2118 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.492840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19e5eb-24b3-44e7-b325-361c56bd2118 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.493115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19e5eb-24b3-44e7-b325-361c56bd2118 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.493863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19e5eb-24b3-44e7-b325-361c56bd2118 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:06.494167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19e5eb-24b3-44e7-b325-361c56bd2118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.495573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19e5eb-24b3-44e7-b325-361c56bd2118 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.498411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251fcb-0c23-43c4-a6f9-8add84658d8b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.507397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 154/324] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:06.509906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19e5eb-24b3-44e7-b325-361c56bd2118 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.521306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.534069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.603751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251fcb-0c23-43c4-a6f9-8add84658d8b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.615525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19e5eb-24b3-44e7-b325-361c56bd2118 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.637660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f3165-3328-4c54-a934-446cbd5cbaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.638453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3165-3328-4c54-a934-446cbd5cbaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.638731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3165-3328-4c54-a934-446cbd5cbaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.639003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3165-3328-4c54-a934-446cbd5cbaf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.640183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f3165-3328-4c54-a934-446cbd5cbaf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.641619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f3165-3328-4c54-a934-446cbd5cbaf7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.643816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 171/325] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:06.644976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3410da-9d8b-482e-8d1f-4ad2cda67f0e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.645256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3410da-9d8b-482e-8d1f-4ad2cda67f0e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.645528 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3410da-9d8b-482e-8d1f-4ad2cda67f0e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.646757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 172/326] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:06.649208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3410da-9d8b-482e-8d1f-4ad2cda67f0e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.653216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b628ca1-8b59-4016-af8c-eaaa92259dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.654091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b628ca1-8b59-4016-af8c-eaaa92259dde None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.654374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b628ca1-8b59-4016-af8c-eaaa92259dde None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.654642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b628ca1-8b59-4016-af8c-eaaa92259dde None admin] PATH_INFO: `/v3/users/576102374ad74fe2923134c3b00e3766` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.655881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b628ca1-8b59-4016-af8c-eaaa92259dde None admin] RBAC: Authorizing `identity:get_user(user_id=576102374ad74fe2923134c3b00e3766)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.657309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b628ca1-8b59-4016-af8c-eaaa92259dde None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.658964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 155/327] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/users/576102374ad74fe2923134c3b00e3766 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:06.660207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282cbc8-abdf-40fa-b15d-25191864ddbe None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.660484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282cbc8-abdf-40fa-b15d-25191864ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.660758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282cbc8-abdf-40fa-b15d-25191864ddbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.677175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3282cbc8-abdf-40fa-b15d-25191864ddbe None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:06.678348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3282cbc8-abdf-40fa-b15d-25191864ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:06.742769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 156/328] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:06.743612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282cbc8-abdf-40fa-b15d-25191864ddbe None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.751284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.752880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3410da-9d8b-482e-8d1f-4ad2cda67f0e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.763263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.787158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91175f-665a-44a6-829d-e3ff33a1e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.787818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91175f-665a-44a6-829d-e3ff33a1e333 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.788096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91175f-665a-44a6-829d-e3ff33a1e333 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.788368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91175f-665a-44a6-829d-e3ff33a1e333 None admin] PATH_INFO: `/v3/groups` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.789046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91175f-665a-44a6-829d-e3ff33a1e333 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.790458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91175f-665a-44a6-829d-e3ff33a1e333 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.841276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282cbc8-abdf-40fa-b15d-25191864ddbe None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.875338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ae2db-eac4-45f4-a248-90d0c4179a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.875924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ae2db-eac4-45f4-a248-90d0c4179a73 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.876203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ae2db-eac4-45f4-a248-90d0c4179a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.876478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ae2db-eac4-45f4-a248-90d0c4179a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.877960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ae2db-eac4-45f4-a248-90d0c4179a73 None admin] RBAC: Adding query filter params (role.id=e9661633951e4db5a9b85f9a3bdfe777, user.id=576102374ad74fe2923134c3b00e3766, scope.system=all) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:06.878268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ae2db-eac4-45f4-a248-90d0c4179a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.879884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ae2db-eac4-45f4-a248-90d0c4179a73 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.886026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 173/329] 10.222.0.13 () {60 vars in 1134 bytes} [Thu Jun 2 09:54:06 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:54:06.886926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91175f-665a-44a6-829d-e3ff33a1e333 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.891844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 157/330] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/role_assignments?user.id=576102374ad74fe2923134c3b00e3766&scope.system=all&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 510 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:07.056568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91175f-665a-44a6-829d-e3ff33a1e333 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.095141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb38b-4ac6-4532-bdf7-61a0df33e320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.096422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb38b-4ac6-4532-bdf7-61a0df33e320 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.096701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb38b-4ac6-4532-bdf7-61a0df33e320 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.096969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb38b-4ac6-4532-bdf7-61a0df33e320 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.109319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddeb38b-4ac6-4532-bdf7-61a0df33e320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-dddeb38b-4ac6-4532-bdf7-61a0df33e320 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:07.117727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:07.118588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 174/331] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:07.125977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ae2db-eac4-45f4-a248-90d0c4179a73 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.191726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.230881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ae2db-eac4-45f4-a248-90d0c4179a73 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.269700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f81c10-bdc0-4861-ba85-ed10b5488e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.270380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f81c10-bdc0-4861-ba85-ed10b5488e04 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.270664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f81c10-bdc0-4861-ba85-ed10b5488e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.270939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f81c10-bdc0-4861-ba85-ed10b5488e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.271733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f81c10-bdc0-4861-ba85-ed10b5488e04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:07.272130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f81c10-bdc0-4861-ba85-ed10b5488e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:07.274752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f81c10-bdc0-4861-ba85-ed10b5488e04 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:07.281965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 158/332] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:07.288232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb38b-4ac6-4532-bdf7-61a0df33e320 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.317655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.402008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb38b-4ac6-4532-bdf7-61a0df33e320 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.438700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cd157-aa6a-4555-80ab-ee7fbc339186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.439988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd157-aa6a-4555-80ab-ee7fbc339186 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.440473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd157-aa6a-4555-80ab-ee7fbc339186 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.440964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd157-aa6a-4555-80ab-ee7fbc339186 None admin] PATH_INFO: `/v3/users/f965d784d2e44fd2818ccc92eacb9a4b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.442371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cd157-aa6a-4555-80ab-ee7fbc339186 None admin] RBAC: Authorizing `identity:get_user(user_id=f965d784d2e44fd2818ccc92eacb9a4b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:07.444095 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cd157-aa6a-4555-80ab-ee7fbc339186 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:07.445971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 175/333] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/users/f965d784d2e44fd2818ccc92eacb9a4b => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:07.451775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f81c10-bdc0-4861-ba85-ed10b5488e04 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.566005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f81c10-bdc0-4861-ba85-ed10b5488e04 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.594326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.604256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6fdd7-9541-4c6d-9233-6f3ce211426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.605125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6fdd7-9541-4c6d-9233-6f3ce211426a None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.605402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6fdd7-9541-4c6d-9233-6f3ce211426a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.613506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6fdd7-9541-4c6d-9233-6f3ce211426a None admin] PATH_INFO: `/v3/system/users/f965d784d2e44fd2818ccc92eacb9a4b/roles/61c5b1b2390148b883b9a95a739b6736` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.613506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6fdd7-9541-4c6d-9233-6f3ce211426a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f965d784d2e44fd2818ccc92eacb9a4b, role_id=61c5b1b2390148b883b9a95a739b6736)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:07.613506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6fdd7-9541-4c6d-9233-6f3ce211426a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:07.721116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 159/334] 10.222.0.13 () {58 vars in 1334 bytes} [Thu Jun 2 09:54:07 2022] PUT /identity/v3/system/users/f965d784d2e44fd2818ccc92eacb9a4b/roles/61c5b1b2390148b883b9a95a739b6736 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:09.883450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffa77f-1bde-4f4d-b980-2343b9dfe8a9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:09.884472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffa77f-1bde-4f4d-b980-2343b9dfe8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:09.884960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffa77f-1bde-4f4d-b980-2343b9dfe8a9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:09.886757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 176/335] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:09.893381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bf9f-af34-4b9c-b038-8860de1318f3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:09.894288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bf9f-af34-4b9c-b038-8860de1318f3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:09.894900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bf9f-af34-4b9c-b038-8860de1318f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:09.915891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0b26bf9f-af34-4b9c-b038-8860de1318f3 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:09.917408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0b26bf9f-af34-4b9c-b038-8860de1318f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:10.005846 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 160/336] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:10.043316 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffa77f-1bde-4f4d-b980-2343b9dfe8a9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:10.065664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0f416-b17b-49a9-815e-cd0848185b6e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:10.066228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0f416-b17b-49a9-815e-cd0848185b6e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:10.066682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0f416-b17b-49a9-815e-cd0848185b6e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:10.068564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 161/337] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:10.074177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad607d2-b640-465f-95cc-870a46834863 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:10.074681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad607d2-b640-465f-95cc-870a46834863 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:10.075158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad607d2-b640-465f-95cc-870a46834863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:10.105599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2ad607d2-b640-465f-95cc-870a46834863 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:10.107741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2ad607d2-b640-465f-95cc-870a46834863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:10.238482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:10.256167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffa77f-1bde-4f4d-b980-2343b9dfe8a9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:10.265793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 162/338] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:10.343052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad607d2-b640-465f-95cc-870a46834863 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:10.353726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4aca-8dd0-4a41-a581-f992c302abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:10.354541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4aca-8dd0-4a41-a581-f992c302abed None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:10.354824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4aca-8dd0-4a41-a581-f992c302abed None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:10.355130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4aca-8dd0-4a41-a581-f992c302abed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:10.373837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e4aca-8dd0-4a41-a581-f992c302abed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6b5e4aca-8dd0-4a41-a581-f992c302abed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:10.383586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:10.384499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:10.385315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:10.387565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 177/339] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:10.392517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4aca-8dd0-4a41-a581-f992c302abed None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:10.422402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:10.483041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad607d2-b640-465f-95cc-870a46834863 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:10.530802 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdba0ef-0aba-4bcb-bc38-414964cc0b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:10.531771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba0ef-0aba-4bcb-bc38-414964cc0b0c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:10.531950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba0ef-0aba-4bcb-bc38-414964cc0b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:10.532223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba0ef-0aba-4bcb-bc38-414964cc0b0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:10.543773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdba0ef-0aba-4bcb-bc38-414964cc0b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ccdba0ef-0aba-4bcb-bc38-414964cc0b0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:10.552537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:10.553510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:10.554299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:10.558700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 163/340] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:10.561864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f414a6-6f05-41da-b965-30d8e97e703b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:10.562157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f414a6-6f05-41da-b965-30d8e97e703b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:10.562430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f414a6-6f05-41da-b965-30d8e97e703b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:10.564626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 164/341] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:10.565778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f414a6-6f05-41da-b965-30d8e97e703b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:10.592444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4aca-8dd0-4a41-a581-f992c302abed None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:10.644590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f8523-f7f9-49ca-bdcd-e09d8924d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:10.646579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f8523-f7f9-49ca-bdcd-e09d8924d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:10.647062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f8523-f7f9-49ca-bdcd-e09d8924d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:10.647565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f8523-f7f9-49ca-bdcd-e09d8924d2f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:10.649417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f8523-f7f9-49ca-bdcd-e09d8924d2f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:10.649935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f8523-f7f9-49ca-bdcd-e09d8924d2f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:10.652367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f8523-f7f9-49ca-bdcd-e09d8924d2f7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:10.663656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 178/342] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:10.666524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ac64b-0437-48db-9d72-58a183b70b7f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:10.667761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ac64b-0437-48db-9d72-58a183b70b7f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:10.668970 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ac64b-0437-48db-9d72-58a183b70b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:10.704156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-657ac64b-0437-48db-9d72-58a183b70b7f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:10.705759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-657ac64b-0437-48db-9d72-58a183b70b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:10.719310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:10.749778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f414a6-6f05-41da-b965-30d8e97e703b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:10.768839 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:10.819246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde2933-6920-4c54-a560-4ebf6d31eb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:10.819855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde2933-6920-4c54-a560-4ebf6d31eb25 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:10.820134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde2933-6920-4c54-a560-4ebf6d31eb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:10.820407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde2933-6920-4c54-a560-4ebf6d31eb25 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:10.821175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde2933-6920-4c54-a560-4ebf6d31eb25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:10.821480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde2933-6920-4c54-a560-4ebf6d31eb25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:10.822918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde2933-6920-4c54-a560-4ebf6d31eb25 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:10.830732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 179/343] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:10.831645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ac64b-0437-48db-9d72-58a183b70b7f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:10.837790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 165/344] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:10.843901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde2933-6920-4c54-a560-4ebf6d31eb25 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:10.988572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde2933-6920-4c54-a560-4ebf6d31eb25 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:10.989984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ac64b-0437-48db-9d72-58a183b70b7f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:11.031087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c47f3d-1c96-4806-ba73-5be8fde970da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:11.032148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47f3d-1c96-4806-ba73-5be8fde970da None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.032680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47f3d-1c96-4806-ba73-5be8fde970da None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.033181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47f3d-1c96-4806-ba73-5be8fde970da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.034028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559f9ce-23ed-468e-97ff-967ef6d85bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:11.034679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559f9ce-23ed-468e-97ff-967ef6d85bef None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.034963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559f9ce-23ed-468e-97ff-967ef6d85bef None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.035305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559f9ce-23ed-468e-97ff-967ef6d85bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.064780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:11.092731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:11.125321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c47f3d-1c96-4806-ba73-5be8fde970da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:11.127871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c47f3d-1c96-4806-ba73-5be8fde970da None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:11.129133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559f9ce-23ed-468e-97ff-967ef6d85bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:11.130916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559f9ce-23ed-468e-97ff-967ef6d85bef None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:11.266370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 180/345] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:11.268191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c47f3d-1c96-4806-ba73-5be8fde970da None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:11.287834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 166/346] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:11.287834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505675bb-ea1d-4434-a66a-3fb992590f46 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.287834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505675bb-ea1d-4434-a66a-3fb992590f46 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.287834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505675bb-ea1d-4434-a66a-3fb992590f46 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.288295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 167/347] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:11.289799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93658e19-9ba7-45ea-8930-f3b38672adcd None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.290471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93658e19-9ba7-45ea-8930-f3b38672adcd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.290471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93658e19-9ba7-45ea-8930-f3b38672adcd None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.292095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 168/348] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:11.293338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93658e19-9ba7-45ea-8930-f3b38672adcd None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:11.333544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:11.393549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:11.408390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c47f3d-1c96-4806-ba73-5be8fde970da None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:11.435607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93658e19-9ba7-45ea-8930-f3b38672adcd None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:11.457718 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d346094-555d-4e1d-aa3b-6e415b2c7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:11.458540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d346094-555d-4e1d-aa3b-6e415b2c7b82 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.460029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d346094-555d-4e1d-aa3b-6e415b2c7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.460029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d346094-555d-4e1d-aa3b-6e415b2c7b82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.481221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eef40e-9832-4b76-9a26-2ea4dc95e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:11.481639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d346094-555d-4e1d-aa3b-6e415b2c7b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:11.481742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eef40e-9832-4b76-9a26-2ea4dc95e700 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.481742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eef40e-9832-4b76-9a26-2ea4dc95e700 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.481742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eef40e-9832-4b76-9a26-2ea4dc95e700 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.482468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eef40e-9832-4b76-9a26-2ea4dc95e700 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:11.484470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eef40e-9832-4b76-9a26-2ea4dc95e700 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:11.486879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 169/349] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:11 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:11.488046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6f0dd-4fde-4e49-aedc-0655958128b8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.488288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6f0dd-4fde-4e49-aedc-0655958128b8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.488565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6f0dd-4fde-4e49-aedc-0655958128b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1d346094-555d-4e1d-aa3b-6e415b2c7b82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:11.490547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:11.491518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:11.492350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 181/350] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:11.493057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d346094-555d-4e1d-aa3b-6e415b2c7b82 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:11.512476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-16f6f0dd-4fde-4e49-aedc-0655958128b8 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:11.513669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-16f6f0dd-4fde-4e49-aedc-0655958128b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:11.591922 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 170/351] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:11.593648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2bf6f-0725-4fc2-b992-8624648c0bfe None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.594064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2bf6f-0725-4fc2-b992-8624648c0bfe None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.594346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2bf6f-0725-4fc2-b992-8624648c0bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.614606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c1d2bf6f-0725-4fc2-b992-8624648c0bfe None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:11.616201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c1d2bf6f-0725-4fc2-b992-8624648c0bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:11.618000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d346094-555d-4e1d-aa3b-6e415b2c7b82 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:11.619919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:11.662614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e8ac8-ab14-4efe-ad7c-e3b57ef43faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:11.663434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e8ac8-ab14-4efe-ad7c-e3b57ef43faf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.663713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e8ac8-ab14-4efe-ad7c-e3b57ef43faf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.663988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e8ac8-ab14-4efe-ad7c-e3b57ef43faf None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.666172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e8ac8-ab14-4efe-ad7c-e3b57ef43faf None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:11.667651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e8ac8-ab14-4efe-ad7c-e3b57ef43faf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:11.669343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 182/352] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:11 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:11.670103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e8ac8-ab14-4efe-ad7c-e3b57ef43faf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:11.690160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:11.695648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 171/353] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:11.696545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2bf6f-0725-4fc2-b992-8624648c0bfe None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:11.794637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e8ac8-ab14-4efe-ad7c-e3b57ef43faf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:11.819010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2bf6f-0725-4fc2-b992-8624648c0bfe None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:11.834268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68b230-f217-4cd0-8653-4377945e560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:11.835945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68b230-f217-4cd0-8653-4377945e560b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.835945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68b230-f217-4cd0-8653-4377945e560b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.835945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68b230-f217-4cd0-8653-4377945e560b None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.841740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68b230-f217-4cd0-8653-4377945e560b None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:11.843230 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68b230-f217-4cd0-8653-4377945e560b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:11.845597 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 183/354] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:11 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:11.846759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015e4e-4254-404e-a3e6-9487387b89a0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.847151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015e4e-4254-404e-a3e6-9487387b89a0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.847436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015e4e-4254-404e-a3e6-9487387b89a0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.849148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 184/355] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:11.849767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015e4e-4254-404e-a3e6-9487387b89a0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:11.867140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d6c88-1245-40b8-8444-27070cf6a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:11.867824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d6c88-1245-40b8-8444-27070cf6a58d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.868107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d6c88-1245-40b8-8444-27070cf6a58d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.868377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d6c88-1245-40b8-8444-27070cf6a58d None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.869130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d6c88-1245-40b8-8444-27070cf6a58d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:11.869433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d6c88-1245-40b8-8444-27070cf6a58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:11.870802 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d6c88-1245-40b8-8444-27070cf6a58d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:11.881904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 172/356] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:11.882563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d6c88-1245-40b8-8444-27070cf6a58d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:11.896836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:11.954609 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:11.982147 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015e4e-4254-404e-a3e6-9487387b89a0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.002923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d6c88-1245-40b8-8444-27070cf6a58d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.019427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac59e-dec2-4569-a271-89a1269e7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.020243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac59e-dec2-4569-a271-89a1269e7b59 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.020634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac59e-dec2-4569-a271-89a1269e7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.020916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac59e-dec2-4569-a271-89a1269e7b59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.034182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ac59e-dec2-4569-a271-89a1269e7b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3a8ac59e-dec2-4569-a271-89a1269e7b59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:12.042232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:12.043195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:12.044007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:12.044835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 185/357] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:12.045422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac59e-dec2-4569-a271-89a1269e7b59 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.051725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56a84e-ea0d-4e84-98cf-fff84c167602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.052589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56a84e-ea0d-4e84-98cf-fff84c167602 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.052865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56a84e-ea0d-4e84-98cf-fff84c167602 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.053136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56a84e-ea0d-4e84-98cf-fff84c167602 None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.055351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56a84e-ea0d-4e84-98cf-fff84c167602 None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.056794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56a84e-ea0d-4e84-98cf-fff84c167602 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.058559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 173/358] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:11 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:12.059191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56a84e-ea0d-4e84-98cf-fff84c167602 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.161765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.171707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac59e-dec2-4569-a271-89a1269e7b59 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.177540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56a84e-ea0d-4e84-98cf-fff84c167602 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.210100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.214848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753e858-1370-46eb-a7e4-ecc854653f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.215672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753e858-1370-46eb-a7e4-ecc854653f14 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.215958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753e858-1370-46eb-a7e4-ecc854653f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.216236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753e858-1370-46eb-a7e4-ecc854653f14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.218137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047db22-9e4f-4af0-b7ca-34e6fe692695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.218803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047db22-9e4f-4af0-b7ca-34e6fe692695 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.219128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047db22-9e4f-4af0-b7ca-34e6fe692695 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.224348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047db22-9e4f-4af0-b7ca-34e6fe692695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.224348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047db22-9e4f-4af0-b7ca-34e6fe692695 None admin] RBAC: Adding query filter params (group.id=8d73f836e1b04c42aadd67a12d4f3a17, role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=fcdefa8d9129437abc74ff4d6d386083) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:12.224348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047db22-9e4f-4af0-b7ca-34e6fe692695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.224348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047db22-9e4f-4af0-b7ca-34e6fe692695 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.228842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 174/359] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/role_assignments?group.id=8d73f836e1b04c42aadd67a12d4f3a17&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:12.228997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753e858-1370-46eb-a7e4-ecc854653f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:12.230001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8da72-9ec1-44fd-8da3-de1c6ec74d66 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.230287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8da72-9ec1-44fd-8da3-de1c6ec74d66 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.230556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8da72-9ec1-44fd-8da3-de1c6ec74d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c753e858-1370-46eb-a7e4-ecc854653f14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:12.237085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:12.238098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:12.239505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 186/360] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:12.243590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753e858-1370-46eb-a7e4-ecc854653f14 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.248596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-46e8da72-9ec1-44fd-8da3-de1c6ec74d66 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:12.249815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-46e8da72-9ec1-44fd-8da3-de1c6ec74d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:12.350204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 175/361] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:12.350880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8da72-9ec1-44fd-8da3-de1c6ec74d66 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.389839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753e858-1370-46eb-a7e4-ecc854653f14 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.436620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62656a7-9a71-47f9-ab63-e1ed24ee83c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.437462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62656a7-9a71-47f9-ab63-e1ed24ee83c2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.437754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62656a7-9a71-47f9-ab63-e1ed24ee83c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.439649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62656a7-9a71-47f9-ab63-e1ed24ee83c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.471838 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.477243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8da72-9ec1-44fd-8da3-de1c6ec74d66 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.508800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.525848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62656a7-9a71-47f9-ab63-e1ed24ee83c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.527051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b6b5a-098b-47d8-98b9-eafac15cb8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.527535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62656a7-9a71-47f9-ab63-e1ed24ee83c2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.527811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b6b5a-098b-47d8-98b9-eafac15cb8fa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.528093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b6b5a-098b-47d8-98b9-eafac15cb8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.528368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b6b5a-098b-47d8-98b9-eafac15cb8fa None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.529122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b6b5a-098b-47d8-98b9-eafac15cb8fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:12.529437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b6b5a-098b-47d8-98b9-eafac15cb8fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.533423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b6b5a-098b-47d8-98b9-eafac15cb8fa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.546526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 176/362] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:12.547850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b6b5a-098b-47d8-98b9-eafac15cb8fa None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.656100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 187/363] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:12.658998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62656a7-9a71-47f9-ab63-e1ed24ee83c2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.689387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b6b5a-098b-47d8-98b9-eafac15cb8fa None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.721721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.733949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562301be-8b1b-4e4e-98c5-23220cd2a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.733949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562301be-8b1b-4e4e-98c5-23220cd2a608 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.733949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562301be-8b1b-4e4e-98c5-23220cd2a608 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.733949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562301be-8b1b-4e4e-98c5-23220cd2a608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.734314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562301be-8b1b-4e4e-98c5-23220cd2a608 None admin] RBAC: Adding query filter params (group.id=8d73f836e1b04c42aadd67a12d4f3a17, role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=372aa814f19d46d68ffb05087f0d23f8) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:12.734314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562301be-8b1b-4e4e-98c5-23220cd2a608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.736136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562301be-8b1b-4e4e-98c5-23220cd2a608 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.743140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 177/364] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/role_assignments?group.id=8d73f836e1b04c42aadd67a12d4f3a17&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:12.743939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562301be-8b1b-4e4e-98c5-23220cd2a608 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.787723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62656a7-9a71-47f9-ab63-e1ed24ee83c2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.810761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.843416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c07af-935e-449e-8eff-cb6e67b479f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.844150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c07af-935e-449e-8eff-cb6e67b479f4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.844433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c07af-935e-449e-8eff-cb6e67b479f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.844736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c07af-935e-449e-8eff-cb6e67b479f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.845500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c07af-935e-449e-8eff-cb6e67b479f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:12.845811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c07af-935e-449e-8eff-cb6e67b479f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.847231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c07af-935e-449e-8eff-cb6e67b479f4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.857392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 188/365] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:12.858283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c07af-935e-449e-8eff-cb6e67b479f4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.887873 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562301be-8b1b-4e4e-98c5-23220cd2a608 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.940347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5267eec-2a67-4b99-9a82-018ad2a5a1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.941866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5267eec-2a67-4b99-9a82-018ad2a5a1be None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.942391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5267eec-2a67-4b99-9a82-018ad2a5a1be None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.942886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5267eec-2a67-4b99-9a82-018ad2a5a1be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.958737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5267eec-2a67-4b99-9a82-018ad2a5a1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e5267eec-2a67-4b99-9a82-018ad2a5a1be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:12.970079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:12.971039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:54:12.971876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:12.979392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 178/366] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:12.979392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5267eec-2a67-4b99-9a82-018ad2a5a1be None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.996309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c07af-935e-449e-8eff-cb6e67b479f4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.015573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.037244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd11b8-9e4c-4941-9088-849ee5097b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.038729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd11b8-9e4c-4941-9088-849ee5097b98 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.039288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd11b8-9e4c-4941-9088-849ee5097b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.039786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd11b8-9e4c-4941-9088-849ee5097b98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.117164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5267eec-2a67-4b99-9a82-018ad2a5a1be None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.117833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd11b8-9e4c-4941-9088-849ee5097b98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.119608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd11b8-9e4c-4941-9088-849ee5097b98 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.129608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.153842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e621-3b72-403b-bcfb-d472a37b6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.155076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e621-3b72-403b-bcfb-d472a37b6d7a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.155582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e621-3b72-403b-bcfb-d472a37b6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.156099 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e621-3b72-403b-bcfb-d472a37b6d7a None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.158020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3e621-3b72-403b-bcfb-d472a37b6d7a None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.159894 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3e621-3b72-403b-bcfb-d472a37b6d7a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.166296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 179/367] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:13.167417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e621-3b72-403b-bcfb-d472a37b6d7a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.255015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 189/368] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:13.256182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd11b8-9e4c-4941-9088-849ee5097b98 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.278103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.282621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e621-3b72-403b-bcfb-d472a37b6d7a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.322765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1b033-6aea-4eab-a62e-f66a27eabf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.323641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1b033-6aea-4eab-a62e-f66a27eabf48 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.323927 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1b033-6aea-4eab-a62e-f66a27eabf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.324205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1b033-6aea-4eab-a62e-f66a27eabf48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.378254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd11b8-9e4c-4941-9088-849ee5097b98 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.385067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.407994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1b033-6aea-4eab-a62e-f66a27eabf48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.409879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1b033-6aea-4eab-a62e-f66a27eabf48 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.427301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eeec5e-ce20-495e-bbcd-0783b24d5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.428014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeec5e-ce20-495e-bbcd-0783b24d5292 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.428841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeec5e-ce20-495e-bbcd-0783b24d5292 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.429128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeec5e-ce20-495e-bbcd-0783b24d5292 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.429893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eeec5e-ce20-495e-bbcd-0783b24d5292 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:13.430227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eeec5e-ce20-495e-bbcd-0783b24d5292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.432148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eeec5e-ce20-495e-bbcd-0783b24d5292 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.448649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 190/369] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:13.448649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eeec5e-ce20-495e-bbcd-0783b24d5292 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.535552 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.543695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 180/370] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:13.546094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1b033-6aea-4eab-a62e-f66a27eabf48 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.565337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eeec5e-ce20-495e-bbcd-0783b24d5292 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.607978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86d02a-56a8-4221-99b5-d2cb2dcfa39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.609221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86d02a-56a8-4221-99b5-d2cb2dcfa39c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.609720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86d02a-56a8-4221-99b5-d2cb2dcfa39c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.610347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86d02a-56a8-4221-99b5-d2cb2dcfa39c None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.611883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86d02a-56a8-4221-99b5-d2cb2dcfa39c None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.613669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86d02a-56a8-4221-99b5-d2cb2dcfa39c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.615649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 191/371] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:13.616725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86d02a-56a8-4221-99b5-d2cb2dcfa39c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.636941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.665773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1b033-6aea-4eab-a62e-f66a27eabf48 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.710393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b294d5a-4aed-44bf-937f-e111d704e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.711525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b294d5a-4aed-44bf-937f-e111d704e483 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.711807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b294d5a-4aed-44bf-937f-e111d704e483 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.712080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b294d5a-4aed-44bf-937f-e111d704e483 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.713635 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b294d5a-4aed-44bf-937f-e111d704e483 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.715058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b294d5a-4aed-44bf-937f-e111d704e483 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.717557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 181/372] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:13.718317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b294d5a-4aed-44bf-937f-e111d704e483 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.730673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86d02a-56a8-4221-99b5-d2cb2dcfa39c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.767309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea284f8-6d26-4bf2-b6e6-1685bc42d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.768487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea284f8-6d26-4bf2-b6e6-1685bc42d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.769022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea284f8-6d26-4bf2-b6e6-1685bc42d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.769517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea284f8-6d26-4bf2-b6e6-1685bc42d1f2 None admin] PATH_INFO: `/v3/users/f965d784d2e44fd2818ccc92eacb9a4b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.771043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea284f8-6d26-4bf2-b6e6-1685bc42d1f2 None admin] RBAC: Authorizing `identity:get_user(user_id=f965d784d2e44fd2818ccc92eacb9a4b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.772841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea284f8-6d26-4bf2-b6e6-1685bc42d1f2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.775140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 192/373] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/users/f965d784d2e44fd2818ccc92eacb9a4b => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:13.776198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea284f8-6d26-4bf2-b6e6-1685bc42d1f2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.793632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.838585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b294d5a-4aed-44bf-937f-e111d704e483 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.886904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca71d-9d26-42df-9a5e-8d07460dcb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.888030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca71d-9d26-42df-9a5e-8d07460dcb21 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.888314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca71d-9d26-42df-9a5e-8d07460dcb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.888584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca71d-9d26-42df-9a5e-8d07460dcb21 None admin] PATH_INFO: `/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.890852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea284f8-6d26-4bf2-b6e6-1685bc42d1f2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.892374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cca71d-9d26-42df-9a5e-8d07460dcb21 None admin] RBAC: Authorizing `identity:get_project(project_id=a4fcfbbe473b47bea6be4001c8a8fd93)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.895186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cca71d-9d26-42df-9a5e-8d07460dcb21 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.902389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 182/374] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:13.902888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca71d-9d26-42df-9a5e-8d07460dcb21 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.920950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.943589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0fa56-6c71-4098-badd-47d0d5da1583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.944580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0fa56-6c71-4098-badd-47d0d5da1583 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.945076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0fa56-6c71-4098-badd-47d0d5da1583 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.945544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0fa56-6c71-4098-badd-47d0d5da1583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.947069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0fa56-6c71-4098-badd-47d0d5da1583 None admin] RBAC: Adding query filter params (group.id=8d73f836e1b04c42aadd67a12d4f3a17, role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=372aa814f19d46d68ffb05087f0d23f8) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:13.947626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0fa56-6c71-4098-badd-47d0d5da1583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.950077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0fa56-6c71-4098-badd-47d0d5da1583 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.959487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 193/375] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/role_assignments?group.id=8d73f836e1b04c42aadd67a12d4f3a17&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:13.960647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0fa56-6c71-4098-badd-47d0d5da1583 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:14.064768 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:14.086211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca71d-9d26-42df-9a5e-8d07460dcb21 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:14.093887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0fa56-6c71-4098-badd-47d0d5da1583 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:14.141111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb2f1-8c4d-4a8f-b574-139d05adf054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:14.142685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb2f1-8c4d-4a8f-b574-139d05adf054 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:14.143232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb2f1-8c4d-4a8f-b574-139d05adf054 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:14.143720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb2f1-8c4d-4a8f-b574-139d05adf054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:14.145097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb2f1-8c4d-4a8f-b574-139d05adf054 None admin] RBAC: Adding query filter params (role.id=61c5b1b2390148b883b9a95a739b6736, user.id=f965d784d2e44fd2818ccc92eacb9a4b, scope.system=all) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:14.145949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb2f1-8c4d-4a8f-b574-139d05adf054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:14.147646 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb2f1-8c4d-4a8f-b574-139d05adf054 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:14.165844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 194/376] 10.222.0.13 () {56 vars in 1308 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/role_assignments?user.id=f965d784d2e44fd2818ccc92eacb9a4b&scope.system=all&role.id=61c5b1b2390148b883b9a95a739b6736 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:14.168610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce47995-f00b-475e-9a94-2203a0249342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:14.170059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb2f1-8c4d-4a8f-b574-139d05adf054 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:14.172098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce47995-f00b-475e-9a94-2203a0249342 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:14.172679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce47995-f00b-475e-9a94-2203a0249342 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:14.175070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce47995-f00b-475e-9a94-2203a0249342 None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:14.176832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce47995-f00b-475e-9a94-2203a0249342 None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:14.179819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce47995-f00b-475e-9a94-2203a0249342 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:14.188314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 183/377] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:14.194372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce47995-f00b-475e-9a94-2203a0249342 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:14.305683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:14.329531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce47995-f00b-475e-9a94-2203a0249342 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:14.371123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3f63c-af9e-4043-92fd-67777be5ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:14.372857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3f63c-af9e-4043-92fd-67777be5ffcf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:14.373397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3f63c-af9e-4043-92fd-67777be5ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:14.374025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3f63c-af9e-4043-92fd-67777be5ffcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:14.375072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3f63c-af9e-4043-92fd-67777be5ffcf None admin] RBAC: Adding query filter params (group.id=8d73f836e1b04c42aadd67a12d4f3a17, role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=fcdefa8d9129437abc74ff4d6d386083) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:14.375811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3f63c-af9e-4043-92fd-67777be5ffcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:14.377755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3f63c-af9e-4043-92fd-67777be5ffcf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:14.385165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 184/378] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:14 2022] GET /identity/v3/role_assignments?group.id=8d73f836e1b04c42aadd67a12d4f3a17&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:14.419471 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb2f1-8c4d-4a8f-b574-139d05adf054 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:14.465183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dad99-cf7c-4857-bd24-a180b5ab415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:14.466082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dad99-cf7c-4857-bd24-a180b5ab415f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:14.466363 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dad99-cf7c-4857-bd24-a180b5ab415f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:14.466642 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dad99-cf7c-4857-bd24-a180b5ab415f None admin] PATH_INFO: `/v3/groups/f1e5355f7398445496cc624fceeee301` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:14.470629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:14.479941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dad99-cf7c-4857-bd24-a180b5ab415f None admin] RBAC: Authorizing `identity:get_group(group_id=f1e5355f7398445496cc624fceeee301)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:14.481427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dad99-cf7c-4857-bd24-a180b5ab415f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:14.483466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 195/379] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:14 2022] GET /identity/v3/groups/f1e5355f7398445496cc624fceeee301 => generated 229 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:14.489526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3f63c-af9e-4043-92fd-67777be5ffcf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:14.611214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3f63c-af9e-4043-92fd-67777be5ffcf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:14.648741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245154c-cbf2-4ea7-98dc-8ee31ae839c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:14.649777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245154c-cbf2-4ea7-98dc-8ee31ae839c6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:14.650259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245154c-cbf2-4ea7-98dc-8ee31ae839c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:14.650751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245154c-cbf2-4ea7-98dc-8ee31ae839c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:14.651808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245154c-cbf2-4ea7-98dc-8ee31ae839c6 None admin] RBAC: Adding query filter params (group.id=f1e5355f7398445496cc624fceeee301, role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=a4fcfbbe473b47bea6be4001c8a8fd93) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:14.652340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245154c-cbf2-4ea7-98dc-8ee31ae839c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:14.653950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245154c-cbf2-4ea7-98dc-8ee31ae839c6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:14.660719 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 185/380] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:14 2022] GET /identity/v3/role_assignments?group.id=f1e5355f7398445496cc624fceeee301&scope.project.id=a4fcfbbe473b47bea6be4001c8a8fd93&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:14.709691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d8db6-d0fc-4fdd-b727-ae7219f468f5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:14.710012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d8db6-d0fc-4fdd-b727-ae7219f468f5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:14.710245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d8db6-d0fc-4fdd-b727-ae7219f468f5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:14.711668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 196/381] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:14.718334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8926-ad4b-4404-a934-797abe287b65 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:14.718941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8926-ad4b-4404-a934-797abe287b65 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:14.719508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8926-ad4b-4404-a934-797abe287b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:14.738254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-151f8926-ad4b-4404-a934-797abe287b65 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:14.739852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-151f8926-ad4b-4404-a934-797abe287b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:14.743510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:14.823495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 186/382] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:14.851557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d8db6-d0fc-4fdd-b727-ae7219f468f5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:14.988462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d8db6-d0fc-4fdd-b727-ae7219f468f5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:15.033458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa6b6-0c5d-4ddd-aecb-ab975bd58626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:15.034261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa6b6-0c5d-4ddd-aecb-ab975bd58626 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.034541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa6b6-0c5d-4ddd-aecb-ab975bd58626 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.034815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa6b6-0c5d-4ddd-aecb-ab975bd58626 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.048748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baa6b6-0c5d-4ddd-aecb-ab975bd58626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a7baa6b6-0c5d-4ddd-aecb-ab975bd58626 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:15.056417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:15.057307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:15.058080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 197/383] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:15.068255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8926-ad4b-4404-a934-797abe287b65 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:15.190936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8926-ad4b-4404-a934-797abe287b65 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:15.227919 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eea5dc-f745-4181-9aae-fd194fbf7a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:15.228592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eea5dc-f745-4181-9aae-fd194fbf7a8b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.228873 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eea5dc-f745-4181-9aae-fd194fbf7a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.229144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eea5dc-f745-4181-9aae-fd194fbf7a8b None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.229889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eea5dc-f745-4181-9aae-fd194fbf7a8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:15.230193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eea5dc-f745-4181-9aae-fd194fbf7a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:15.231586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eea5dc-f745-4181-9aae-fd194fbf7a8b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:15.243200 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 187/384] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:15.256224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa6b6-0c5d-4ddd-aecb-ab975bd58626 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:15.366445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:15.427197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa6b6-0c5d-4ddd-aecb-ab975bd58626 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:15.451905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143e0c9-66f4-4c0d-abcd-b06338891be2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.452188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143e0c9-66f4-4c0d-abcd-b06338891be2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.452459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143e0c9-66f4-4c0d-abcd-b06338891be2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.454012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 188/385] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:15.459690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5588b8-ac4b-4cce-8920-1b394452481c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.460225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5588b8-ac4b-4cce-8920-1b394452481c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.460786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5588b8-ac4b-4cce-8920-1b394452481c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.467310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:15.474850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec635f6-17eb-4431-9d26-abf17c843190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:15.475767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec635f6-17eb-4431-9d26-abf17c843190 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.476051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec635f6-17eb-4431-9d26-abf17c843190 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.476330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec635f6-17eb-4431-9d26-abf17c843190 None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.479826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec635f6-17eb-4431-9d26-abf17c843190 None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:15.485565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec635f6-17eb-4431-9d26-abf17c843190 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:15.485692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3d5588b8-ac4b-4cce-8920-1b394452481c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:15.485780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 198/386] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:15 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:15.485849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3d5588b8-ac4b-4cce-8920-1b394452481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:15.493048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec635f6-17eb-4431-9d26-abf17c843190 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:15.578386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 189/387] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:15.612823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5588b8-ac4b-4cce-8920-1b394452481c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:15.682820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec635f6-17eb-4431-9d26-abf17c843190 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:15.726854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5588b8-ac4b-4cce-8920-1b394452481c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:15.740175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:15.758509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3af49-8b8b-430c-8126-22d80c0fab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:15.759568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3af49-8b8b-430c-8126-22d80c0fab35 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.759958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3af49-8b8b-430c-8126-22d80c0fab35 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.760327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3af49-8b8b-430c-8126-22d80c0fab35 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.760726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:15.761726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3af49-8b8b-430c-8126-22d80c0fab35 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:15.767115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3af49-8b8b-430c-8126-22d80c0fab35 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:15.767115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 199/388] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:15 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:15.771279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3af49-8b8b-430c-8126-22d80c0fab35 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:15.772997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2c28-0e5e-4333-8f38-4a375d9ff262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:15.773807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2c28-0e5e-4333-8f38-4a375d9ff262 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.774146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2c28-0e5e-4333-8f38-4a375d9ff262 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.774421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2c28-0e5e-4333-8f38-4a375d9ff262 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.799653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e2c28-0e5e-4333-8f38-4a375d9ff262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9f1e2c28-0e5e-4333-8f38-4a375d9ff262 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:15.810107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:15.811008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:15.811867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 190/389] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:15.832888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2c28-0e5e-4333-8f38-4a375d9ff262 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:15.963597 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3af49-8b8b-430c-8126-22d80c0fab35 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.003822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2c28-0e5e-4333-8f38-4a375d9ff262 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.024176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c04c0-457a-40a8-8933-669e6220d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.025069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c04c0-457a-40a8-8933-669e6220d9f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.025350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c04c0-457a-40a8-8933-669e6220d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.025625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c04c0-457a-40a8-8933-669e6220d9f1 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083/groups/8d73f836e1b04c42aadd67a12d4f3a17/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.029345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c04c0-457a-40a8-8933-669e6220d9f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdefa8d9129437abc74ff4d6d386083, group_id=8d73f836e1b04c42aadd67a12d4f3a17, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.032967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c04c0-457a-40a8-8933-669e6220d9f1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.054005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7b250-7014-4a58-a572-7d2eeb39ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.054677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7b250-7014-4a58-a572-7d2eeb39ff3b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.055079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7b250-7014-4a58-a572-7d2eeb39ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.055420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7b250-7014-4a58-a572-7d2eeb39ff3b None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.056226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7b250-7014-4a58-a572-7d2eeb39ff3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:16.071553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7b250-7014-4a58-a572-7d2eeb39ff3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.071553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7b250-7014-4a58-a572-7d2eeb39ff3b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.071553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 191/390] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:16.073143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7b250-7014-4a58-a572-7d2eeb39ff3b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.134859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:16.149557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 200/391] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:15 2022] PUT /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083/groups/8d73f836e1b04c42aadd67a12d4f3a17/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:16.186381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7b250-7014-4a58-a572-7d2eeb39ff3b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.231087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cea769-afed-4f50-bccc-1469cf95379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.232988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cea769-afed-4f50-bccc-1469cf95379e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.233507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cea769-afed-4f50-bccc-1469cf95379e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.234014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cea769-afed-4f50-bccc-1469cf95379e None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.235791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cea769-afed-4f50-bccc-1469cf95379e None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.237642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cea769-afed-4f50-bccc-1469cf95379e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.240115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 192/392] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:16.246252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c04c0-457a-40a8-8933-669e6220d9f1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.311577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:16.373341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c04c0-457a-40a8-8933-669e6220d9f1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.413464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383098b-d610-4158-8034-51654f612b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.414258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383098b-d610-4158-8034-51654f612b8a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.414537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383098b-d610-4158-8034-51654f612b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.414810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383098b-d610-4158-8034-51654f612b8a None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.416587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383098b-d610-4158-8034-51654f612b8a None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.418027 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383098b-d610-4158-8034-51654f612b8a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.420040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 201/393] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:16.426267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cea769-afed-4f50-bccc-1469cf95379e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.543789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cea769-afed-4f50-bccc-1469cf95379e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.571448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:16.579345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a59d57-d696-4e20-963e-ad8ab62ac3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.580227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a59d57-d696-4e20-963e-ad8ab62ac3a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.580510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a59d57-d696-4e20-963e-ad8ab62ac3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.583352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a59d57-d696-4e20-963e-ad8ab62ac3a8 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8/groups/8d73f836e1b04c42aadd67a12d4f3a17/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.583352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a59d57-d696-4e20-963e-ad8ab62ac3a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=372aa814f19d46d68ffb05087f0d23f8, group_id=8d73f836e1b04c42aadd67a12d4f3a17, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.584393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a59d57-d696-4e20-963e-ad8ab62ac3a8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.590024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ce5d2-f10c-44c5-9b63-32c5ce295f86 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.590381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ce5d2-f10c-44c5-9b63-32c5ce295f86 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.590726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ce5d2-f10c-44c5-9b63-32c5ce295f86 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.592350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 202/394] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:16.599428 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d170e-9f9f-4059-9a0c-635157160112 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.599921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d170e-9f9f-4059-9a0c-635157160112 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.600450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d170e-9f9f-4059-9a0c-635157160112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.618353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-aa1d170e-9f9f-4059-9a0c-635157160112 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:16.619961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-aa1d170e-9f9f-4059-9a0c-635157160112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:16.668229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 193/395] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:16 2022] PUT /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8/groups/8d73f836e1b04c42aadd67a12d4f3a17/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:16.711120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 203/396] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:16.756643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a59d57-d696-4e20-963e-ad8ab62ac3a8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.881039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a59d57-d696-4e20-963e-ad8ab62ac3a8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.918472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a7829-5b36-4a33-b776-ce806716e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.919650 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a7829-5b36-4a33-b776-ce806716e2ff None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.920133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a7829-5b36-4a33-b776-ce806716e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.920668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a7829-5b36-4a33-b776-ce806716e2ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.932628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a7829-5b36-4a33-b776-ce806716e2ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-122a7829-5b36-4a33-b776-ce806716e2ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:16.941548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:16.942453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:16.943270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:16.946043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 194/397] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:16.951647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d170e-9f9f-4059-9a0c-635157160112 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.011384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.062071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d170e-9f9f-4059-9a0c-635157160112 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.098829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5027910-8b04-48a5-a6e0-0462a5595e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.099539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5027910-8b04-48a5-a6e0-0462a5595e25 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.099818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5027910-8b04-48a5-a6e0-0462a5595e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.100097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5027910-8b04-48a5-a6e0-0462a5595e25 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.100845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5027910-8b04-48a5-a6e0-0462a5595e25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:17.101197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5027910-8b04-48a5-a6e0-0462a5595e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.102562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5027910-8b04-48a5-a6e0-0462a5595e25 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.111925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 204/398] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:17.120418 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a7829-5b36-4a33-b776-ce806716e2ff None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.187828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.261353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a7829-5b36-4a33-b776-ce806716e2ff None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.321488 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8a5c6-1e3e-452b-887c-37578df8fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.322346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8a5c6-1e3e-452b-887c-37578df8fedf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.322629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8a5c6-1e3e-452b-887c-37578df8fedf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.322904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8a5c6-1e3e-452b-887c-37578df8fedf None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.327794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8a5c6-1e3e-452b-887c-37578df8fedf None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.329772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8a5c6-1e3e-452b-887c-37578df8fedf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.331761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 195/399] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:17.337315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5027910-8b04-48a5-a6e0-0462a5595e25 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.478224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5027910-8b04-48a5-a6e0-0462a5595e25 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.499077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.524699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ef5e5-1c02-407d-a5bb-86524eb089ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.525572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ef5e5-1c02-407d-a5bb-86524eb089ea None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.525856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ef5e5-1c02-407d-a5bb-86524eb089ea None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.526136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ef5e5-1c02-407d-a5bb-86524eb089ea None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.527362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ef5e5-1c02-407d-a5bb-86524eb089ea None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.528791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ef5e5-1c02-407d-a5bb-86524eb089ea None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.535420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 205/400] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:17.536966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8a5c6-1e3e-452b-887c-37578df8fedf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.577809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd55e5-6ba0-45b3-9f95-90b50dcc7c71 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.578114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd55e5-6ba0-45b3-9f95-90b50dcc7c71 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.578413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd55e5-6ba0-45b3-9f95-90b50dcc7c71 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.580444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 206/401] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:17.592223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76deb2e-5a46-4f9e-8393-2d867c4d4f99 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.592508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76deb2e-5a46-4f9e-8393-2d867c4d4f99 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.592784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76deb2e-5a46-4f9e-8393-2d867c4d4f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.622914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a76deb2e-5a46-4f9e-8393-2d867c4d4f99 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:17.624147 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a76deb2e-5a46-4f9e-8393-2d867c4d4f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:17.675126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8a5c6-1e3e-452b-887c-37578df8fedf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.691446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.706898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 207/402] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:17.708388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9950d1a-0d9d-49c6-adf3-612d45bc8fc9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.708681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9950d1a-0d9d-49c6-adf3-612d45bc8fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.708961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9950d1a-0d9d-49c6-adf3-612d45bc8fc9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.710710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 208/403] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:17.716894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefd44a-8d7d-4bb9-953f-108f4f586502 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.717186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefd44a-8d7d-4bb9-953f-108f4f586502 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.717464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefd44a-8d7d-4bb9-953f-108f4f586502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.736387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3b421-7357-4cf4-ab89-d746ae355aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.737193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b421-7357-4cf4-ab89-d746ae355aba None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.737473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b421-7357-4cf4-ab89-d746ae355aba None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.737746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b421-7357-4cf4-ab89-d746ae355aba None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8/groups/8d73f836e1b04c42aadd67a12d4f3a17/roles/cd5bf20507a2408d8f752cc0be80f77f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.741211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3b421-7357-4cf4-ab89-d746ae355aba None admin] RBAC: Authorizing `identity:create_grant(project_id=372aa814f19d46d68ffb05087f0d23f8, group_id=8d73f836e1b04c42aadd67a12d4f3a17, role_id=cd5bf20507a2408d8f752cc0be80f77f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.742647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3b421-7357-4cf4-ab89-d746ae355aba None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.747354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2aefd44a-8d7d-4bb9-953f-108f4f586502 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:17.748669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2aefd44a-8d7d-4bb9-953f-108f4f586502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:17.824283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 209/404] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:17.831174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefd44a-8d7d-4bb9-953f-108f4f586502 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.843761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 196/405] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:17 2022] PUT /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8/groups/8d73f836e1b04c42aadd67a12d4f3a17/roles/cd5bf20507a2408d8f752cc0be80f77f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:17.857838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3b421-7357-4cf4-ab89-d746ae355aba None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.883503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.950845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefd44a-8d7d-4bb9-953f-108f4f586502 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.990883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390702-f149-46bb-87f6-958eccc4ce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.992100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390702-f149-46bb-87f6-958eccc4ce61 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.992666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390702-f149-46bb-87f6-958eccc4ce61 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.993157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390702-f149-46bb-87f6-958eccc4ce61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.001063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3b421-7357-4cf4-ab89-d746ae355aba None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.006643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0390702-f149-46bb-87f6-958eccc4ce61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e0390702-f149-46bb-87f6-958eccc4ce61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:18.015291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:18.016322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:18.017106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:18.019737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 210/406] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:18.026083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390702-f149-46bb-87f6-958eccc4ce61 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.081790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a45d84-548a-4b0c-8b91-b6d193aad230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.082623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a45d84-548a-4b0c-8b91-b6d193aad230 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.082907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a45d84-548a-4b0c-8b91-b6d193aad230 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.083306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a45d84-548a-4b0c-8b91-b6d193aad230 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.097654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a45d84-548a-4b0c-8b91-b6d193aad230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-67a45d84-548a-4b0c-8b91-b6d193aad230 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:18.106044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:18.106941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:18.107770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:18.108871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 197/407] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:18.120025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a45d84-548a-4b0c-8b91-b6d193aad230 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.154112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.171331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390702-f149-46bb-87f6-958eccc4ce61 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.175434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.214497 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04e03e-68ea-4443-bb76-5f9e1202e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.215952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e03e-68ea-4443-bb76-5f9e1202e719 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.216632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e03e-68ea-4443-bb76-5f9e1202e719 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.217086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e03e-68ea-4443-bb76-5f9e1202e719 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.218149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04e03e-68ea-4443-bb76-5f9e1202e719 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:18.218865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04e03e-68ea-4443-bb76-5f9e1202e719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.220507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04e03e-68ea-4443-bb76-5f9e1202e719 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.232949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 211/408] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:18.238791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04e03e-68ea-4443-bb76-5f9e1202e719 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.239627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a45d84-548a-4b0c-8b91-b6d193aad230 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.312924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e5fc5-844a-4ada-9265-c7f183585191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.313626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e5fc5-844a-4ada-9265-c7f183585191 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.313881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e5fc5-844a-4ada-9265-c7f183585191 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.314155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e5fc5-844a-4ada-9265-c7f183585191 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.314917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e5fc5-844a-4ada-9265-c7f183585191 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:18.315251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e5fc5-844a-4ada-9265-c7f183585191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.316669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e5fc5-844a-4ada-9265-c7f183585191 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.339479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 198/409] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:18.345499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e5fc5-844a-4ada-9265-c7f183585191 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.453037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04e03e-68ea-4443-bb76-5f9e1202e719 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.455486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.465748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e5fc5-844a-4ada-9265-c7f183585191 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.505990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037717-49f2-482e-9243-766513e163a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.506865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037717-49f2-482e-9243-766513e163a8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.507170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037717-49f2-482e-9243-766513e163a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.507451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037717-49f2-482e-9243-766513e163a8 None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.508917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b037717-49f2-482e-9243-766513e163a8 None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.510750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b037717-49f2-482e-9243-766513e163a8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.513441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 199/410] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:18.518981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037717-49f2-482e-9243-766513e163a8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.538804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdebcc-406a-42b3-b42c-dfc3e831edbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.539704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdebcc-406a-42b3-b42c-dfc3e831edbd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.539989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdebcc-406a-42b3-b42c-dfc3e831edbd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.540268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdebcc-406a-42b3-b42c-dfc3e831edbd None admin] PATH_INFO: `/v3/groups/f1e5355f7398445496cc624fceeee301` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.544620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdebcc-406a-42b3-b42c-dfc3e831edbd None admin] RBAC: Authorizing `identity:get_group(group_id=f1e5355f7398445496cc624fceeee301)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.546910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdebcc-406a-42b3-b42c-dfc3e831edbd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.549155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 212/411] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/groups/f1e5355f7398445496cc624fceeee301 => generated 229 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:18.554714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdebcc-406a-42b3-b42c-dfc3e831edbd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.593795 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.702852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037717-49f2-482e-9243-766513e163a8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.709991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdebcc-406a-42b3-b42c-dfc3e831edbd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.766510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ecb1a-612f-47bc-99eb-318a97461f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.767417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ecb1a-612f-47bc-99eb-318a97461f69 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.767701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ecb1a-612f-47bc-99eb-318a97461f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.767973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ecb1a-612f-47bc-99eb-318a97461f69 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.769578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ecb1a-612f-47bc-99eb-318a97461f69 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.771003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ecb1a-612f-47bc-99eb-318a97461f69 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.773888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 200/412] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:18.775051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfd160-78f0-45c0-a817-d9a40aa8a3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.775942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd160-78f0-45c0-a817-d9a40aa8a3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.776223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd160-78f0-45c0-a817-d9a40aa8a3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.776498 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd160-78f0-45c0-a817-d9a40aa8a3d6 None admin] PATH_INFO: `/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.777686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfd160-78f0-45c0-a817-d9a40aa8a3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=a4fcfbbe473b47bea6be4001c8a8fd93)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.779238 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfd160-78f0-45c0-a817-d9a40aa8a3d6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.782352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ecb1a-612f-47bc-99eb-318a97461f69 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.783372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 213/413] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93 => generated 344 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:18.787318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfd160-78f0-45c0-a817-d9a40aa8a3d6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.823998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.959593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfd160-78f0-45c0-a817-d9a40aa8a3d6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.961582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.965212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ecb1a-612f-47bc-99eb-318a97461f69 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.997699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb37719-3aaf-46c4-8cf2-4c31930f13d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.999562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb37719-3aaf-46c4-8cf2-4c31930f13d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.999894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb37719-3aaf-46c4-8cf2-4c31930f13d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.000656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb37719-3aaf-46c4-8cf2-4c31930f13d2 None admin] PATH_INFO: `/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93/groups/f1e5355f7398445496cc624fceeee301/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.002742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb37719-3aaf-46c4-8cf2-4c31930f13d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4fcfbbe473b47bea6be4001c8a8fd93, group_id=f1e5355f7398445496cc624fceeee301, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.004597 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb37719-3aaf-46c4-8cf2-4c31930f13d2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.027407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd02ab-81dd-4fac-bdf6-6b408f5f8028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.028349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd02ab-81dd-4fac-bdf6-6b408f5f8028 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.028630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd02ab-81dd-4fac-bdf6-6b408f5f8028 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.028904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd02ab-81dd-4fac-bdf6-6b408f5f8028 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083/groups/8d73f836e1b04c42aadd67a12d4f3a17/roles/cd5bf20507a2408d8f752cc0be80f77f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.031288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd02ab-81dd-4fac-bdf6-6b408f5f8028 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcdefa8d9129437abc74ff4d6d386083, group_id=8d73f836e1b04c42aadd67a12d4f3a17, role_id=cd5bf20507a2408d8f752cc0be80f77f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.033299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd02ab-81dd-4fac-bdf6-6b408f5f8028 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.086457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 214/414] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:18 2022] PUT /identity/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93/groups/f1e5355f7398445496cc624fceeee301/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:54:19.087727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41560a-b23a-459f-a495-fb03cafcce72 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.088013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41560a-b23a-459f-a495-fb03cafcce72 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.088286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41560a-b23a-459f-a495-fb03cafcce72 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.089759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 215/415] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:19.097324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f323ff-adde-447e-a6f7-15efc9929728 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.097324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f323ff-adde-447e-a6f7-15efc9929728 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.097324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f323ff-adde-447e-a6f7-15efc9929728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.118370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-42f323ff-adde-447e-a6f7-15efc9929728 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:19.120041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-42f323ff-adde-447e-a6f7-15efc9929728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:19.132715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 201/416] 10.222.0.13 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:18 2022] PUT /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083/groups/8d73f836e1b04c42aadd67a12d4f3a17/roles/cd5bf20507a2408d8f752cc0be80f77f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:19.211887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 216/417] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:19.236229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd02ab-81dd-4fac-bdf6-6b408f5f8028 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.373299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.387660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd02ab-81dd-4fac-bdf6-6b408f5f8028 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.428969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eeaaf-1b13-4bfc-ac46-723127f5a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.429788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eeaaf-1b13-4bfc-ac46-723127f5a497 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.430113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eeaaf-1b13-4bfc-ac46-723127f5a497 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.430390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eeaaf-1b13-4bfc-ac46-723127f5a497 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.459860 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eeaaf-1b13-4bfc-ac46-723127f5a497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9e9eeaaf-1b13-4bfc-ac46-723127f5a497 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:19.467735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:19.468617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:19.469737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 202/418] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:19.474971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f323ff-adde-447e-a6f7-15efc9929728 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.572412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.582038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f323ff-adde-447e-a6f7-15efc9929728 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.617859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aa35a-224d-444c-b618-a50527b94df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.618848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aa35a-224d-444c-b618-a50527b94df5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.619332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aa35a-224d-444c-b618-a50527b94df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.619763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aa35a-224d-444c-b618-a50527b94df5 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.620686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aa35a-224d-444c-b618-a50527b94df5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:19.621146 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aa35a-224d-444c-b618-a50527b94df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.622664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aa35a-224d-444c-b618-a50527b94df5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.632346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 217/419] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:19.637533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eeaaf-1b13-4bfc-ac46-723127f5a497 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.680066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061406-3522-44f5-a035-eb3a77203d1c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.680662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061406-3522-44f5-a035-eb3a77203d1c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.680940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061406-3522-44f5-a035-eb3a77203d1c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.682599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 218/420] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:19.687326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35765b82-dfe1-49cd-9c73-716dbeb71ec3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.688172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35765b82-dfe1-49cd-9c73-716dbeb71ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.688451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35765b82-dfe1-49cd-9c73-716dbeb71ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.713166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-35765b82-dfe1-49cd-9c73-716dbeb71ec3 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:19.714341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-35765b82-dfe1-49cd-9c73-716dbeb71ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:19.783861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eeaaf-1b13-4bfc-ac46-723127f5a497 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.802200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 219/421] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:19.840833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35765b82-dfe1-49cd-9c73-716dbeb71ec3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.860459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c424-f24a-4b0c-905d-d0b9b37679f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.861280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c424-f24a-4b0c-905d-d0b9b37679f3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.861565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c424-f24a-4b0c-905d-d0b9b37679f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.861891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c424-f24a-4b0c-905d-d0b9b37679f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.899586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.004914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.012153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62c424-f24a-4b0c-905d-d0b9b37679f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.013622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62c424-f24a-4b0c-905d-d0b9b37679f3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.014377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35765b82-dfe1-49cd-9c73-716dbeb71ec3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42663022-aa61-431c-b543-7b712d72ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.057256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42663022-aa61-431c-b543-7b712d72ddfc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.058467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42663022-aa61-431c-b543-7b712d72ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.059492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42663022-aa61-431c-b543-7b712d72ddfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.082586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42663022-aa61-431c-b543-7b712d72ddfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-42663022-aa61-431c-b543-7b712d72ddfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:20.094575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:20.095502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:20.096279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:20.105297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 220/422] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:20.110538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42663022-aa61-431c-b543-7b712d72ddfc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.231219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 203/423] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:20.233744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c424-f24a-4b0c-905d-d0b9b37679f3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.294027 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42663022-aa61-431c-b543-7b712d72ddfc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.333462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76191870-e318-40fc-82ae-74ce0e4aa09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.334736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76191870-e318-40fc-82ae-74ce0e4aa09f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.337324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76191870-e318-40fc-82ae-74ce0e4aa09f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.337811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76191870-e318-40fc-82ae-74ce0e4aa09f None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.338761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76191870-e318-40fc-82ae-74ce0e4aa09f None admin] RBAC: Adding query filter params (name=member) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:20.339454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76191870-e318-40fc-82ae-74ce0e4aa09f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.342356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76191870-e318-40fc-82ae-74ce0e4aa09f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.362012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 221/424] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:20.375482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.376684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76191870-e318-40fc-82ae-74ce0e4aa09f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.403469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.488989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76191870-e318-40fc-82ae-74ce0e4aa09f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.514900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c424-f24a-4b0c-905d-d0b9b37679f3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.530078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8baf47-5ae6-40a7-8ba3-266609c929e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.531173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8baf47-5ae6-40a7-8ba3-266609c929e6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.531958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8baf47-5ae6-40a7-8ba3-266609c929e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.532509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8baf47-5ae6-40a7-8ba3-266609c929e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.550598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc255-b6d7-4e32-99f9-cccd42b40151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.551509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc255-b6d7-4e32-99f9-cccd42b40151 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.551787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc255-b6d7-4e32-99f9-cccd42b40151 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.552059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc255-b6d7-4e32-99f9-cccd42b40151 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.553221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddc255-b6d7-4e32-99f9-cccd42b40151 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.554733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddc255-b6d7-4e32-99f9-cccd42b40151 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.556437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 204/425] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:20.557792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664323b7-7680-48f3-9c21-11ec5f2406fa None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.558074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664323b7-7680-48f3-9c21-11ec5f2406fa None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.558342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664323b7-7680-48f3-9c21-11ec5f2406fa None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.559743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 205/426] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:20.565121 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664323b7-7680-48f3-9c21-11ec5f2406fa None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.620451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8baf47-5ae6-40a7-8ba3-266609c929e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.621907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8baf47-5ae6-40a7-8ba3-266609c929e6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.633827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.678478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664323b7-7680-48f3-9c21-11ec5f2406fa None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.698114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.717359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09802196-83b5-4faa-ad6b-c4827c006094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.718346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09802196-83b5-4faa-ad6b-c4827c006094 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.718758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09802196-83b5-4faa-ad6b-c4827c006094 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.719174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09802196-83b5-4faa-ad6b-c4827c006094 None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.720547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09802196-83b5-4faa-ad6b-c4827c006094 None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.722231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09802196-83b5-4faa-ad6b-c4827c006094 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.724627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 206/427] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:20.726018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e34333-1195-4cab-a977-917d0e21d92b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.726403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e34333-1195-4cab-a977-917d0e21d92b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.726777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e34333-1195-4cab-a977-917d0e21d92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.747678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-83e34333-1195-4cab-a977-917d0e21d92b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:20.748989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-83e34333-1195-4cab-a977-917d0e21d92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:20.831022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 207/428] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:20.832138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e34333-1195-4cab-a977-917d0e21d92b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.913810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 222/429] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:20.913810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8baf47-5ae6-40a7-8ba3-266609c929e6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.977964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e34333-1195-4cab-a977-917d0e21d92b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.993901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:21.019280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed168bd9-4a69-4c3a-8929-d15b74d87005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.019280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168bd9-4a69-4c3a-8929-d15b74d87005 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.019280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168bd9-4a69-4c3a-8929-d15b74d87005 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.019280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168bd9-4a69-4c3a-8929-d15b74d87005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.019690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8baf47-5ae6-40a7-8ba3-266609c929e6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.019765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed168bd9-4a69-4c3a-8929-d15b74d87005 None admin] RBAC: Adding query filter params (group.id=8d73f836e1b04c42aadd67a12d4f3a17, role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=fcdefa8d9129437abc74ff4d6d386083) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:21.019765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed168bd9-4a69-4c3a-8929-d15b74d87005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.021725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed168bd9-4a69-4c3a-8929-d15b74d87005 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.026264 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:21.029124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 208/430] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/role_assignments?group.id=8d73f836e1b04c42aadd67a12d4f3a17&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:21.030133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed168bd9-4a69-4c3a-8929-d15b74d87005 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.056920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996e45-0d47-4430-9ef3-4ab0392b3a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.061797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996e45-0d47-4430-9ef3-4ab0392b3a81 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.061797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996e45-0d47-4430-9ef3-4ab0392b3a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.061797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996e45-0d47-4430-9ef3-4ab0392b3a81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.072895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996e45-0d47-4430-9ef3-4ab0392b3a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d7996e45-0d47-4430-9ef3-4ab0392b3a81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:21.083724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:21.084865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:21.085865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:21.088849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 223/431] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:21.099611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996e45-0d47-4430-9ef3-4ab0392b3a81 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.212035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed168bd9-4a69-4c3a-8929-d15b74d87005 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.278363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d0b05-614c-4795-8bed-33a17224e072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.279259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d0b05-614c-4795-8bed-33a17224e072 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.279538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d0b05-614c-4795-8bed-33a17224e072 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.279806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d0b05-614c-4795-8bed-33a17224e072 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.282750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d0b05-614c-4795-8bed-33a17224e072 None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.284241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d0b05-614c-4795-8bed-33a17224e072 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.286105 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 209/432] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:21.291357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d0b05-614c-4795-8bed-33a17224e072 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.293446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996e45-0d47-4430-9ef3-4ab0392b3a81 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.339647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406d195-720b-449c-ae2b-9d8b858c460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.340330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406d195-720b-449c-ae2b-9d8b858c460f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.340612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406d195-720b-449c-ae2b-9d8b858c460f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.340886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406d195-720b-449c-ae2b-9d8b858c460f None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.341634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406d195-720b-449c-ae2b-9d8b858c460f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:21.344544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406d195-720b-449c-ae2b-9d8b858c460f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.346134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406d195-720b-449c-ae2b-9d8b858c460f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.351734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:21.357041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 224/433] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:21.363016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406d195-720b-449c-ae2b-9d8b858c460f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.411829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:21.433811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d0b05-614c-4795-8bed-33a17224e072 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.481241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa058b71-ac46-446f-bb4d-1c49f7120e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.482644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa058b71-ac46-446f-bb4d-1c49f7120e5b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.482926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa058b71-ac46-446f-bb4d-1c49f7120e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.483234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa058b71-ac46-446f-bb4d-1c49f7120e5b None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.485809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa058b71-ac46-446f-bb4d-1c49f7120e5b None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.487580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa058b71-ac46-446f-bb4d-1c49f7120e5b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.490510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 210/434] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:21.497092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa058b71-ac46-446f-bb4d-1c49f7120e5b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.513178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406d195-720b-449c-ae2b-9d8b858c460f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.561961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaaf78-5441-47d0-9578-b3b0885874fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.563037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaaf78-5441-47d0-9578-b3b0885874fb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.563565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaaf78-5441-47d0-9578-b3b0885874fb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.564623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaaf78-5441-47d0-9578-b3b0885874fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.624698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa058b71-ac46-446f-bb4d-1c49f7120e5b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.644005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaaf78-5441-47d0-9578-b3b0885874fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.644591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:21.645743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaaf78-5441-47d0-9578-b3b0885874fb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.673109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d534-b856-4c58-ada7-85404a6850ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.674358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d534-b856-4c58-ada7-85404a6850ee None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.675318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:21.675427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d534-b856-4c58-ada7-85404a6850ee None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.675673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d534-b856-4c58-ada7-85404a6850ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.676533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d534-b856-4c58-ada7-85404a6850ee None admin] RBAC: Adding query filter params (group.id=8d73f836e1b04c42aadd67a12d4f3a17, role.id=e9661633951e4db5a9b85f9a3bdfe777, scope.project.id=372aa814f19d46d68ffb05087f0d23f8) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:21.676845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d534-b856-4c58-ada7-85404a6850ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.678266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d534-b856-4c58-ada7-85404a6850ee None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.689986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 211/435] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/role_assignments?group.id=8d73f836e1b04c42aadd67a12d4f3a17&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=e9661633951e4db5a9b85f9a3bdfe777 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:21.777832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 225/436] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:54:21.787193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d534-b856-4c58-ada7-85404a6850ee None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.823243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbee4d-cbf2-415b-b8d0-12ea2ab2d605 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.823593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbee4d-cbf2-415b-b8d0-12ea2ab2d605 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.823968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbee4d-cbf2-415b-b8d0-12ea2ab2d605 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.826082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 226/437] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:21.833009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689d5f-6071-4796-bfbd-5b826a7fb2b6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.833009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689d5f-6071-4796-bfbd-5b826a7fb2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.833255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689d5f-6071-4796-bfbd-5b826a7fb2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.853558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e5689d5f-6071-4796-bfbd-5b826a7fb2b6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:21.854881 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e5689d5f-6071-4796-bfbd-5b826a7fb2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:21.923286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d534-b856-4c58-ada7-85404a6850ee None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.941320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 227/438] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:21.943020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d34cac-706f-4bfb-a9e0-9813ed05a638 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.944135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d34cac-706f-4bfb-a9e0-9813ed05a638 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.944416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d34cac-706f-4bfb-a9e0-9813ed05a638 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.945910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 228/439] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:21.953375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3677-b06d-40d1-a4a6-1ef821df6d0d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.953375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3677-b06d-40d1-a4a6-1ef821df6d0d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.957801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3677-b06d-40d1-a4a6-1ef821df6d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.979148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174a04f-e466-412b-a000-501774ac6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.980018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174a04f-e466-412b-a000-501774ac6a95 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.980297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174a04f-e466-412b-a000-501774ac6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.980573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174a04f-e466-412b-a000-501774ac6a95 None admin] PATH_INFO: `/v3/projects/372aa814f19d46d68ffb05087f0d23f8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.982680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2b8a3677-b06d-40d1-a4a6-1ef821df6d0d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:21.982802 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174a04f-e466-412b-a000-501774ac6a95 None admin] RBAC: Authorizing `identity:get_project(project_id=372aa814f19d46d68ffb05087f0d23f8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.986192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174a04f-e466-412b-a000-501774ac6a95 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.986192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 212/440] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/projects/372aa814f19d46d68ffb05087f0d23f8 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:21.986866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2b8a3677-b06d-40d1-a4a6-1ef821df6d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:21.986994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174a04f-e466-412b-a000-501774ac6a95 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.046274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.074780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.095620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 229/441] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:22.096278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a3677-b06d-40d1-a4a6-1ef821df6d0d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.129095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174a04f-e466-412b-a000-501774ac6a95 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.183586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34a601-48af-4622-bd82-1399df995101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.184423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34a601-48af-4622-bd82-1399df995101 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.185659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34a601-48af-4622-bd82-1399df995101 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.185659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34a601-48af-4622-bd82-1399df995101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.198003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34a601-48af-4622-bd82-1399df995101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-6a34a601-48af-4622-bd82-1399df995101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:22.206448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:22.207484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:22.208305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 213/442] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:22.208946 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34a601-48af-4622-bd82-1399df995101 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.234802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a3677-b06d-40d1-a4a6-1ef821df6d0d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.271465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71605-4347-4b86-a04e-e86af27bb924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.272330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71605-4347-4b86-a04e-e86af27bb924 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.272612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71605-4347-4b86-a04e-e86af27bb924 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.272887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71605-4347-4b86-a04e-e86af27bb924 None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.274052 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff71605-4347-4b86-a04e-e86af27bb924 None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:22.275511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff71605-4347-4b86-a04e-e86af27bb924 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:22.277121 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 230/443] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:22.278037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71605-4347-4b86-a04e-e86af27bb924 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.310620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34a601-48af-4622-bd82-1399df995101 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.317752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.334814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.343868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e949a-24d7-447e-afa4-7eebc1d2d763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.344680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e949a-24d7-447e-afa4-7eebc1d2d763 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.344958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e949a-24d7-447e-afa4-7eebc1d2d763 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.345229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e949a-24d7-447e-afa4-7eebc1d2d763 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.355895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e949a-24d7-447e-afa4-7eebc1d2d763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-4d1e949a-24d7-447e-afa4-7eebc1d2d763 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:22.364081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:22.364945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:22.365724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 214/444] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:22.367351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e949a-24d7-447e-afa4-7eebc1d2d763 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.376726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71605-4347-4b86-a04e-e86af27bb924 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.411554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca78cb3-c2fb-441c-8f2d-ab94efd960d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.412221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca78cb3-c2fb-441c-8f2d-ab94efd960d0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.412495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca78cb3-c2fb-441c-8f2d-ab94efd960d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.412771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca78cb3-c2fb-441c-8f2d-ab94efd960d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.413499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca78cb3-c2fb-441c-8f2d-ab94efd960d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:22.413807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca78cb3-c2fb-441c-8f2d-ab94efd960d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:22.415170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca78cb3-c2fb-441c-8f2d-ab94efd960d0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:22.423683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 231/445] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:22.424337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca78cb3-c2fb-441c-8f2d-ab94efd960d0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.468335 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e949a-24d7-447e-afa4-7eebc1d2d763 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.501585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d284-0cb1-4fbd-a908-9b4649a5e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.502232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d284-0cb1-4fbd-a908-9b4649a5e641 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.502529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d284-0cb1-4fbd-a908-9b4649a5e641 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.502807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d284-0cb1-4fbd-a908-9b4649a5e641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.503664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94d284-0cb1-4fbd-a908-9b4649a5e641 None admin] RBAC: Adding query filter params (group.id=8d73f836e1b04c42aadd67a12d4f3a17, role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=372aa814f19d46d68ffb05087f0d23f8) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:22.503980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94d284-0cb1-4fbd-a908-9b4649a5e641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:22.505404 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94d284-0cb1-4fbd-a908-9b4649a5e641 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:22.511074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 215/446] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/role_assignments?group.id=8d73f836e1b04c42aadd67a12d4f3a17&scope.project.id=372aa814f19d46d68ffb05087f0d23f8&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:22.511866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d284-0cb1-4fbd-a908-9b4649a5e641 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.523381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca78cb3-c2fb-441c-8f2d-ab94efd960d0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.544006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.548900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.567830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bb4e9-5bd5-4951-93e0-bd22ea17fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.568527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bb4e9-5bd5-4951-93e0-bd22ea17fc21 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.568816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bb4e9-5bd5-4951-93e0-bd22ea17fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.569263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bb4e9-5bd5-4951-93e0-bd22ea17fc21 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.570389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bb4e9-5bd5-4951-93e0-bd22ea17fc21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:22.570705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bb4e9-5bd5-4951-93e0-bd22ea17fc21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:22.572150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bb4e9-5bd5-4951-93e0-bd22ea17fc21 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:22.582723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 232/447] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:22.588488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bb4e9-5bd5-4951-93e0-bd22ea17fc21 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.629730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d284-0cb1-4fbd-a908-9b4649a5e641 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.668993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3b6dc-bfb6-4328-837f-23ba21454a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.669660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b6dc-bfb6-4328-837f-23ba21454a5e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.669940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b6dc-bfb6-4328-837f-23ba21454a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.670220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b6dc-bfb6-4328-837f-23ba21454a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.698620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bb4e9-5bd5-4951-93e0-bd22ea17fc21 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.740899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a656f46-da72-4cc9-ade9-bc827a6f2220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.741551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a656f46-da72-4cc9-ade9-bc827a6f2220 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.742001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a656f46-da72-4cc9-ade9-bc827a6f2220 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.742287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a656f46-da72-4cc9-ade9-bc827a6f2220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.749068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3b6dc-bfb6-4328-837f-23ba21454a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:22.751153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3b6dc-bfb6-4328-837f-23ba21454a5e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:22.787052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.803737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.826098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a656f46-da72-4cc9-ade9-bc827a6f2220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:22.827578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a656f46-da72-4cc9-ade9-bc827a6f2220 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:22.868601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 216/448] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:22.874816 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3b6dc-bfb6-4328-837f-23ba21454a5e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.943414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 233/449] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:22.949187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a656f46-da72-4cc9-ade9-bc827a6f2220 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.991696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3b6dc-bfb6-4328-837f-23ba21454a5e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.027628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.034214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bfb66-8e24-4cf1-b0c1-5ddfd91e9159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.035376 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bfb66-8e24-4cf1-b0c1-5ddfd91e9159 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.035805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bfb66-8e24-4cf1-b0c1-5ddfd91e9159 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.042914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bfb66-8e24-4cf1-b0c1-5ddfd91e9159 None admin] PATH_INFO: `/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.042914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bfb66-8e24-4cf1-b0c1-5ddfd91e9159 None admin] RBAC: Authorizing `identity:get_project(project_id=a4fcfbbe473b47bea6be4001c8a8fd93)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.042914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bfb66-8e24-4cf1-b0c1-5ddfd91e9159 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.042914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 217/450] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/projects/a4fcfbbe473b47bea6be4001c8a8fd93 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:23.045948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bfb66-8e24-4cf1-b0c1-5ddfd91e9159 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.054305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.073082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a656f46-da72-4cc9-ade9-bc827a6f2220 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.106651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99a1c-b260-4e3b-a10a-d92c5868a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.107533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99a1c-b260-4e3b-a10a-d92c5868a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.107813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99a1c-b260-4e3b-a10a-d92c5868a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.108082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd99a1c-b260-4e3b-a10a-d92c5868a0a3 None admin] PATH_INFO: `/v3/projects/fcdefa8d9129437abc74ff4d6d386083` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.109781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd99a1c-b260-4e3b-a10a-d92c5868a0a3 None admin] RBAC: Authorizing `identity:get_project(project_id=fcdefa8d9129437abc74ff4d6d386083)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.111227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd99a1c-b260-4e3b-a10a-d92c5868a0a3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.117375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 234/451] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/projects/fcdefa8d9129437abc74ff4d6d386083 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:23.118349 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99a1c-b260-4e3b-a10a-d92c5868a0a3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.148630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bfb66-8e24-4cf1-b0c1-5ddfd91e9159 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.181547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf1faf-7fcb-4260-971f-78afad132c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.182395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf1faf-7fcb-4260-971f-78afad132c6c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.182670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf1faf-7fcb-4260-971f-78afad132c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.182938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf1faf-7fcb-4260-971f-78afad132c6c None admin] PATH_INFO: `/v3/groups/f1e5355f7398445496cc624fceeee301` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.184151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf1faf-7fcb-4260-971f-78afad132c6c None admin] RBAC: Authorizing `identity:get_group(group_id=f1e5355f7398445496cc624fceeee301)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.185545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf1faf-7fcb-4260-971f-78afad132c6c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.187203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 218/452] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/groups/f1e5355f7398445496cc624fceeee301 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:23.192807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf1faf-7fcb-4260-971f-78afad132c6c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.212883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd99a1c-b260-4e3b-a10a-d92c5868a0a3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.246075 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1223e-2d12-42fc-852f-7924d7c71dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.246950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1223e-2d12-42fc-852f-7924d7c71dae None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.247260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1223e-2d12-42fc-852f-7924d7c71dae None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.247529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1223e-2d12-42fc-852f-7924d7c71dae None admin] PATH_INFO: `/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.248677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1223e-2d12-42fc-852f-7924d7c71dae None admin] RBAC: Authorizing `identity:get_group(group_id=8d73f836e1b04c42aadd67a12d4f3a17)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.250103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1223e-2d12-42fc-852f-7924d7c71dae None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.251708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 235/453] 10.222.0.13 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/groups/8d73f836e1b04c42aadd67a12d4f3a17 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:23.256189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.257633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1223e-2d12-42fc-852f-7924d7c71dae None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.275361 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.291600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf1faf-7fcb-4260-971f-78afad132c6c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.324777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c7a20-c414-4fed-9dbd-ee26cd0e1ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.325421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c7a20-c414-4fed-9dbd-ee26cd0e1ada None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.325698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c7a20-c414-4fed-9dbd-ee26cd0e1ada None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.325966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c7a20-c414-4fed-9dbd-ee26cd0e1ada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.326792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c7a20-c414-4fed-9dbd-ee26cd0e1ada None admin] RBAC: Adding query filter params (group.id=f1e5355f7398445496cc624fceeee301, role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=a4fcfbbe473b47bea6be4001c8a8fd93) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:23.327119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c7a20-c414-4fed-9dbd-ee26cd0e1ada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.329079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c7a20-c414-4fed-9dbd-ee26cd0e1ada None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.335158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 219/454] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/role_assignments?group.id=f1e5355f7398445496cc624fceeee301&scope.project.id=a4fcfbbe473b47bea6be4001c8a8fd93&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:23.357696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1223e-2d12-42fc-852f-7924d7c71dae None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.393852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026e94c-7c49-4272-b578-bf1228b8823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.394524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026e94c-7c49-4272-b578-bf1228b8823c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.394808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026e94c-7c49-4272-b578-bf1228b8823c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.395077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026e94c-7c49-4272-b578-bf1228b8823c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.395954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026e94c-7c49-4272-b578-bf1228b8823c None admin] RBAC: Adding query filter params (group.id=8d73f836e1b04c42aadd67a12d4f3a17, role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=fcdefa8d9129437abc74ff4d6d386083) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:23.396262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026e94c-7c49-4272-b578-bf1228b8823c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.397728 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026e94c-7c49-4272-b578-bf1228b8823c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.404584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 236/455] 10.222.0.13 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/role_assignments?group.id=8d73f836e1b04c42aadd67a12d4f3a17&scope.project.id=fcdefa8d9129437abc74ff4d6d386083&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:26.111053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a5e56-8acf-4e74-bbf3-89b608c5c3ea None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.112128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a5e56-8acf-4e74-bbf3-89b608c5c3ea None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.112608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a5e56-8acf-4e74-bbf3-89b608c5c3ea None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.114386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 220/456] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:26.119959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828fedc-28b3-48dc-91ed-6e735df0152f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.120751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828fedc-28b3-48dc-91ed-6e735df0152f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.121261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828fedc-28b3-48dc-91ed-6e735df0152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.147479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3828fedc-28b3-48dc-91ed-6e735df0152f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:26.149052 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3828fedc-28b3-48dc-91ed-6e735df0152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:26.252969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 237/457] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:26.305299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a5e56-8acf-4e74-bbf3-89b608c5c3ea None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.456524 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a5e56-8acf-4e74-bbf3-89b608c5c3ea None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.493400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.499287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb93294-67c2-439d-a4ea-4ac25c65a1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.500098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb93294-67c2-439d-a4ea-4ac25c65a1eb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.500379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb93294-67c2-439d-a4ea-4ac25c65a1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.500656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb93294-67c2-439d-a4ea-4ac25c65a1eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.521207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb93294-67c2-439d-a4ea-4ac25c65a1eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.522727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb93294-67c2-439d-a4ea-4ac25c65a1eb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1bb93294-67c2-439d-a4ea-4ac25c65a1eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:26.546871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:26.547826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:26.548642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:26.548642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:26.548642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.548642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:26.548642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 221/458] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:26.555150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828fedc-28b3-48dc-91ed-6e735df0152f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.567609 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92479630-1c5c-4fac-9eae-ca8c1dbd6e81 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.567900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92479630-1c5c-4fac-9eae-ca8c1dbd6e81 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.568163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92479630-1c5c-4fac-9eae-ca8c1dbd6e81 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.574317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 222/459] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:26.574608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.580491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff06e0-540d-4f47-b2ec-bd9ce121259f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.582486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff06e0-540d-4f47-b2ec-bd9ce121259f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.582766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff06e0-540d-4f47-b2ec-bd9ce121259f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.616129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d6ff06e0-540d-4f47-b2ec-bd9ce121259f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:26.617328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d6ff06e0-540d-4f47-b2ec-bd9ce121259f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:26.734088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828fedc-28b3-48dc-91ed-6e735df0152f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.772956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 223/460] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:26.775040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204db29a-9bec-4eea-b10e-6bc03c816146 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.775522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204db29a-9bec-4eea-b10e-6bc03c816146 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.776025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204db29a-9bec-4eea-b10e-6bc03c816146 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.777433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 224/461] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:26.779517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9c9b-1932-48e7-8126-f653c85f353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.780455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9c9b-1932-48e7-8126-f653c85f353b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.780893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9c9b-1932-48e7-8126-f653c85f353b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.781309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9c9b-1932-48e7-8126-f653c85f353b None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.782212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9c9b-1932-48e7-8126-f653c85f353b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:26.782661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9c9b-1932-48e7-8126-f653c85f353b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.784194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9c9b-1932-48e7-8126-f653c85f353b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.788407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f34f5-8230-4b21-ae38-1d05a0e1870d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.788854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f34f5-8230-4b21-ae38-1d05a0e1870d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.789292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f34f5-8230-4b21-ae38-1d05a0e1870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.807348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-381f34f5-8230-4b21-ae38-1d05a0e1870d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:26.808926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-381f34f5-8230-4b21-ae38-1d05a0e1870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:26.812539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 238/462] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:26.813604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9c9b-1932-48e7-8126-f653c85f353b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.884585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.895297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 225/463] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:26.896357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f34f5-8230-4b21-ae38-1d05a0e1870d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.917278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9c9b-1932-48e7-8126-f653c85f353b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.953870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891451c4-e084-4ed9-a35f-d3fbcfbf8942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.955051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891451c4-e084-4ed9-a35f-d3fbcfbf8942 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.955569 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891451c4-e084-4ed9-a35f-d3fbcfbf8942 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.956048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891451c4-e084-4ed9-a35f-d3fbcfbf8942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.962328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.968249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891451c4-e084-4ed9-a35f-d3fbcfbf8942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.970046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891451c4-e084-4ed9-a35f-d3fbcfbf8942 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-891451c4-e084-4ed9-a35f-d3fbcfbf8942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:26.989769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:26.990707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:26.991813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:26.991813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:26.991813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.991813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:26.993778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 239/464] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:26.994728 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891451c4-e084-4ed9-a35f-d3fbcfbf8942 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.027125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f34f5-8230-4b21-ae38-1d05a0e1870d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.064939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b60b3-033b-417e-936f-c7b0ba4be45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.065613 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b60b3-033b-417e-936f-c7b0ba4be45d None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.065892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b60b3-033b-417e-936f-c7b0ba4be45d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.066163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b60b3-033b-417e-936f-c7b0ba4be45d None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.066861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b60b3-033b-417e-936f-c7b0ba4be45d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.068323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b60b3-033b-417e-936f-c7b0ba4be45d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.102566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891451c4-e084-4ed9-a35f-d3fbcfbf8942 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.126164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.137545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75396b14-9bff-4fb2-afcb-097477dfe5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.138341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75396b14-9bff-4fb2-afcb-097477dfe5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.138625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75396b14-9bff-4fb2-afcb-097477dfe5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.138901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75396b14-9bff-4fb2-afcb-097477dfe5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.149300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75396b14-9bff-4fb2-afcb-097477dfe5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.150741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75396b14-9bff-4fb2-afcb-097477dfe5c5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.163397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 226/465] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:26 2022] POST /identity/v3/users => generated 246 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:27.165696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b60b3-033b-417e-936f-c7b0ba4be45d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-75396b14-9bff-4fb2-afcb-097477dfe5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:27.167521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:27.168376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:27.169923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:27.169923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:27.169923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:27.169923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:27.169923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 240/466] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:27.175492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f6ad-f12e-4828-8d23-486f4606ac0b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.175778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f6ad-f12e-4828-8d23-486f4606ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.176058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f6ad-f12e-4828-8d23-486f4606ac0b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.181584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 241/467] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:27.181584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f6ad-f12e-4828-8d23-486f4606ac0b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.316449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.321107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b60b3-033b-417e-936f-c7b0ba4be45d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.324627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f6ad-f12e-4828-8d23-486f4606ac0b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.363166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fbcb0-d738-4092-8269-db8facaf45e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.364045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd17c-a3d1-4aea-94c4-f257b2320a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.364537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fbcb0-d738-4092-8269-db8facaf45e8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.364849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd17c-a3d1-4aea-94c4-f257b2320a60 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.365201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd17c-a3d1-4aea-94c4-f257b2320a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.365359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fbcb0-d738-4092-8269-db8facaf45e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.365590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd17c-a3d1-4aea-94c4-f257b2320a60 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.365971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fbcb0-d738-4092-8269-db8facaf45e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.366470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd17c-a3d1-4aea-94c4-f257b2320a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:27.366840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd17c-a3d1-4aea-94c4-f257b2320a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.367473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fbcb0-d738-4092-8269-db8facaf45e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:27.367959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fbcb0-d738-4092-8269-db8facaf45e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.368908 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd17c-a3d1-4aea-94c4-f257b2320a60 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.369834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fbcb0-d738-4092-8269-db8facaf45e8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.383055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 227/468] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:27.384435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 242/469] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:27.387511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaf9a9-6a42-48bd-8e9d-c8b104dc0913 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.388027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaf9a9-6a42-48bd-8e9d-c8b104dc0913 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.388599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaf9a9-6a42-48bd-8e9d-c8b104dc0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.390605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fbcb0-d738-4092-8269-db8facaf45e8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.415334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0dfaf9a9-6a42-48bd-8e9d-c8b104dc0913 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:27.416761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0dfaf9a9-6a42-48bd-8e9d-c8b104dc0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:27.433667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.497994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 228/470] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:27.503412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfaf9a9-6a42-48bd-8e9d-c8b104dc0913 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.530849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fbcb0-d738-4092-8269-db8facaf45e8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.566998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29654892-f846-4582-87e7-57bc5d6ce1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.567698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29654892-f846-4582-87e7-57bc5d6ce1f6 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.567981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29654892-f846-4582-87e7-57bc5d6ce1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.568254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29654892-f846-4582-87e7-57bc5d6ce1f6 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.568961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29654892-f846-4582-87e7-57bc5d6ce1f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.570450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29654892-f846-4582-87e7-57bc5d6ce1f6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.614064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.625808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfaf9a9-6a42-48bd-8e9d-c8b104dc0913 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.637366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 243/471] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:27 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:27.638193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29654892-f846-4582-87e7-57bc5d6ce1f6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.667958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955a05-eca2-4a0a-ab43-2282c2145526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.668670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955a05-eca2-4a0a-ab43-2282c2145526 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.668933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955a05-eca2-4a0a-ab43-2282c2145526 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.669199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955a05-eca2-4a0a-ab43-2282c2145526 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.669931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed955a05-eca2-4a0a-ab43-2282c2145526 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.671703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed955a05-eca2-4a0a-ab43-2282c2145526 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.749713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.759568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29654892-f846-4582-87e7-57bc5d6ce1f6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.773203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 229/472] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:27 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:27.773203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce097902-7ae4-4392-91de-75f32104fab0 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.773203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce097902-7ae4-4392-91de-75f32104fab0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.773203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce097902-7ae4-4392-91de-75f32104fab0 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.773203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 230/473] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:27.789243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744787-1790-4c7e-ba43-459b6762ce53 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.789530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744787-1790-4c7e-ba43-459b6762ce53 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.789775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744787-1790-4c7e-ba43-459b6762ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.810683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d4744787-1790-4c7e-ba43-459b6762ce53 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:27.812699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d4744787-1790-4c7e-ba43-459b6762ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:27.848764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9301848-4d08-455b-a92b-6aba6d1bf3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.849587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301848-4d08-455b-a92b-6aba6d1bf3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.849871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301848-4d08-455b-a92b-6aba6d1bf3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.850150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301848-4d08-455b-a92b-6aba6d1bf3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.867570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9301848-4d08-455b-a92b-6aba6d1bf3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.869360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9301848-4d08-455b-a92b-6aba6d1bf3d2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e9301848-4d08-455b-a92b-6aba6d1bf3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:27.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:27.893564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:27.894743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:27.894743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:27.894743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:27.894743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:27.894743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 244/474] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:27.900260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9301848-4d08-455b-a92b-6aba6d1bf3d2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.919661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 231/475] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:27.943413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4744787-1790-4c7e-ba43-459b6762ce53 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.027444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9301848-4d08-455b-a92b-6aba6d1bf3d2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.039587 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:28.071873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c8a4-9294-49b9-afc1-892a3f07af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.072547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0c8a4-9294-49b9-afc1-892a3f07af06 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.072825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0c8a4-9294-49b9-afc1-892a3f07af06 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.073098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0c8a4-9294-49b9-afc1-892a3f07af06 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.073408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4744787-1790-4c7e-ba43-459b6762ce53 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.073820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0c8a4-9294-49b9-afc1-892a3f07af06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:28.074124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0c8a4-9294-49b9-afc1-892a3f07af06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.075700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0c8a4-9294-49b9-afc1-892a3f07af06 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.091859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 245/476] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:28.097807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c8a4-9294-49b9-afc1-892a3f07af06 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.101653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:28.117027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.117693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.117967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.118235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.119025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.120417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.159141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.sql.core [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 09:54:28.159141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 09:54:28.159141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [parameters: {'id': '7c721bfed7204cac840747cc28778211', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 09:54:28.159141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80295) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 02 09:54:28.178594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:54:28.188304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application yield resource Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise self.value Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application session.commit() Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 09:54:28.189254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.flush() Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application compat.raise_( Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 09:54:28.190107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:54:28.190945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:54:28.193079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [parameters: {'id': '7c721bfed7204cac840747cc28778211', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:28.196856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 09:54:28.199109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:28.201466 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 232/477] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 2 09:54:27 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:28.201466 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.222051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c8a4-9294-49b9-afc1-892a3f07af06 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.278191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a6bd-b7c7-432d-ba60-79d1a1bf1ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.279284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a6bd-b7c7-432d-ba60-79d1a1bf1ab7 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.279570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a6bd-b7c7-432d-ba60-79d1a1bf1ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.279844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905a6bd-b7c7-432d-ba60-79d1a1bf1ab7 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.280916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905a6bd-b7c7-432d-ba60-79d1a1bf1ab7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.282607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905a6bd-b7c7-432d-ba60-79d1a1bf1ab7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.331156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14e6f-d29a-4faa-a055-1c4cdf2c63aa None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.370918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 246/478] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:28 2022] POST /identity/v3/users => generated 249 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:28.383058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07753f57-4f40-4209-bd1e-f13e1d92efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.383964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07753f57-4f40-4209-bd1e-f13e1d92efc3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.384246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07753f57-4f40-4209-bd1e-f13e1d92efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.384516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07753f57-4f40-4209-bd1e-f13e1d92efc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.394442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:28.404218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07753f57-4f40-4209-bd1e-f13e1d92efc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-07753f57-4f40-4209-bd1e-f13e1d92efc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:28.413295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:28.414267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:28.415052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:28.418085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 233/479] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:28.424608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a6bd-b7c7-432d-ba60-79d1a1bf1ab7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.509957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:28.570915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905a6bd-b7c7-432d-ba60-79d1a1bf1ab7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.620944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bada8ff-d303-4ea8-9c00-314aa894bd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.621538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bada8ff-d303-4ea8-9c00-314aa894bd60 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.621815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bada8ff-d303-4ea8-9c00-314aa894bd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.622086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bada8ff-d303-4ea8-9c00-314aa894bd60 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.622847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bada8ff-d303-4ea8-9c00-314aa894bd60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:28.623179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bada8ff-d303-4ea8-9c00-314aa894bd60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.625222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bada8ff-d303-4ea8-9c00-314aa894bd60 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.636666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 247/480] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:29.844153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab86ee-66d4-4948-8c1a-aaa5eae6b933 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.850259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab86ee-66d4-4948-8c1a-aaa5eae6b933 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.850259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab86ee-66d4-4948-8c1a-aaa5eae6b933 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.850259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 234/481] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:29.851822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2cca3-d9e3-439a-b68d-8c708f8ef573 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.852209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2cca3-d9e3-439a-b68d-8c708f8ef573 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.852387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2cca3-d9e3-439a-b68d-8c708f8ef573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.869190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-83a2cca3-d9e3-439a-b68d-8c708f8ef573 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:29.870360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-83a2cca3-d9e3-439a-b68d-8c708f8ef573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:29.953761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 248/482] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:30.000882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab86ee-66d4-4948-8c1a-aaa5eae6b933 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.135591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab86ee-66d4-4948-8c1a-aaa5eae6b933 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.176514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974edc2f-4823-48c3-8410-a0a18e8fbcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.177305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974edc2f-4823-48c3-8410-a0a18e8fbcdf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.177580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974edc2f-4823-48c3-8410-a0a18e8fbcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.177847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974edc2f-4823-48c3-8410-a0a18e8fbcdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.189471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974edc2f-4823-48c3-8410-a0a18e8fbcdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-974edc2f-4823-48c3-8410-a0a18e8fbcdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:30.197854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:30.198808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:30.199709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:30.202579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 235/483] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:30.208180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2cca3-d9e3-439a-b68d-8c708f8ef573 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.286289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.364600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2cca3-d9e3-439a-b68d-8c708f8ef573 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.415249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bd570-3fe2-43b5-a586-3f4c70656fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.415843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bd570-3fe2-43b5-a586-3f4c70656fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.416126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bd570-3fe2-43b5-a586-3f4c70656fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.416401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bd570-3fe2-43b5-a586-3f4c70656fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.417150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bd570-3fe2-43b5-a586-3f4c70656fd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:30.417456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bd570-3fe2-43b5-a586-3f4c70656fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.418821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bd570-3fe2-43b5-a586-3f4c70656fd3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:30.432283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 249/484] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:30.437611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974edc2f-4823-48c3-8410-a0a18e8fbcdf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.536983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.549523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7b335-3f34-4c26-904c-01be82eb6300 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.549812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7b335-3f34-4c26-904c-01be82eb6300 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.550091 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7b335-3f34-4c26-904c-01be82eb6300 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.552055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 250/485] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:30.558204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9dc9-8950-4f27-9b23-6fc8828b276d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.558493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9dc9-8950-4f27-9b23-6fc8828b276d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.558777 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9dc9-8950-4f27-9b23-6fc8828b276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.590550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8dfc9dc9-8950-4f27-9b23-6fc8828b276d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:30.591756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8dfc9dc9-8950-4f27-9b23-6fc8828b276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:30.600669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974edc2f-4823-48c3-8410-a0a18e8fbcdf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.657716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629a280-7094-450d-95f3-ac037182481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.658515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a280-7094-450d-95f3-ac037182481d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.658794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a280-7094-450d-95f3-ac037182481d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.659060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a280-7094-450d-95f3-ac037182481d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.670293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629a280-7094-450d-95f3-ac037182481d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.671737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629a280-7094-450d-95f3-ac037182481d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-7629a280-7094-450d-95f3-ac037182481d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:30.688810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:30.689709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:30.690530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:30.690530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:30.690530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:30.690530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:30.690530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 236/486] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:30.695341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629a280-7094-450d-95f3-ac037182481d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.735694 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 251/487] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:30.773719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752e02-7653-4009-b279-f2c6b81624b9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.774005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752e02-7653-4009-b279-f2c6b81624b9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.774436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752e02-7653-4009-b279-f2c6b81624b9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.776164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 252/488] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:30.783272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23714136-e451-47fa-9726-d6bcb45ef517 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.783561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23714136-e451-47fa-9726-d6bcb45ef517 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.783838 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23714136-e451-47fa-9726-d6bcb45ef517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.801199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-23714136-e451-47fa-9726-d6bcb45ef517 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:30.802392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-23714136-e451-47fa-9726-d6bcb45ef517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:30.823965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629a280-7094-450d-95f3-ac037182481d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.837550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.850691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.865125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d2ccf-e916-4e37-b2ce-656886463634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.865800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d2ccf-e916-4e37-b2ce-656886463634 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.866087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d2ccf-e916-4e37-b2ce-656886463634 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.866363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d2ccf-e916-4e37-b2ce-656886463634 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.867124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d2ccf-e916-4e37-b2ce-656886463634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:30.867520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d2ccf-e916-4e37-b2ce-656886463634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.869479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d2ccf-e916-4e37-b2ce-656886463634 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:30.885982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 253/489] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:30.887621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23714136-e451-47fa-9726-d6bcb45ef517 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.894741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 237/490] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:30.897058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d2ccf-e916-4e37-b2ce-656886463634 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.023262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23714136-e451-47fa-9726-d6bcb45ef517 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.030634 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d2ccf-e916-4e37-b2ce-656886463634 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.068265 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e12731-3731-4110-ab02-4533d82a4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.069376 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12731-3731-4110-ab02-4533d82a4358 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.069838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12731-3731-4110-ab02-4533d82a4358 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.070289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e12731-3731-4110-ab02-4533d82a4358 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.071161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0a1c3-eaf0-4f36-9b45-a216dc2c8b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.072035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a1c3-eaf0-4f36-9b45-a216dc2c8b4c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.072387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a1c3-eaf0-4f36-9b45-a216dc2c8b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.072742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a1c3-eaf0-4f36-9b45-a216dc2c8b4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.080279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e12731-3731-4110-ab02-4533d82a4358 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.082081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e12731-3731-4110-ab02-4533d82a4358 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.085572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0a1c3-eaf0-4f36-9b45-a216dc2c8b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5dc0a1c3-eaf0-4f36-9b45-a216dc2c8b4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:31.094505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:31.095623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:31.096681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:31.100689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 254/491] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:31.101533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0a1c3-eaf0-4f36-9b45-a216dc2c8b4c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f8e12731-3731-4110-ab02-4533d82a4358 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:31.107744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:31.108654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:31.109569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:31.112705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 238/492] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:31.114088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e12731-3731-4110-ab02-4533d82a4358 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.144605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.148135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.230382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e12731-3731-4110-ab02-4533d82a4358 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.239593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0a1c3-eaf0-4f36-9b45-a216dc2c8b4c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.279736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b42f98-746f-4b44-8df8-87d7aeca8935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.280874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b42f98-746f-4b44-8df8-87d7aeca8935 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.281358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b42f98-746f-4b44-8df8-87d7aeca8935 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.281828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b42f98-746f-4b44-8df8-87d7aeca8935 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.283316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444bceb-9d8b-44ce-a77c-6010cc0f648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.284275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444bceb-9d8b-44ce-a77c-6010cc0f648a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.284567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444bceb-9d8b-44ce-a77c-6010cc0f648a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.284842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444bceb-9d8b-44ce-a77c-6010cc0f648a None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.286023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444bceb-9d8b-44ce-a77c-6010cc0f648a None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:31.286342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444bceb-9d8b-44ce-a77c-6010cc0f648a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.287748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444bceb-9d8b-44ce-a77c-6010cc0f648a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.294778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b42f98-746f-4b44-8df8-87d7aeca8935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:31.297330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 239/493] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.298224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444bceb-9d8b-44ce-a77c-6010cc0f648a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-66b42f98-746f-4b44-8df8-87d7aeca8935 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:31.303628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:31.304481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:31.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:31.307765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 255/494] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:31.308755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b42f98-746f-4b44-8df8-87d7aeca8935 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.398090 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.407708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.409559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444bceb-9d8b-44ce-a77c-6010cc0f648a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.415936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b42f98-746f-4b44-8df8-87d7aeca8935 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.447718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09e0b-aa78-4b2b-ac8f-b7db33b8b006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.448385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09e0b-aa78-4b2b-ac8f-b7db33b8b006 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.448668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09e0b-aa78-4b2b-ac8f-b7db33b8b006 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.448942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09e0b-aa78-4b2b-ac8f-b7db33b8b006 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.449773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e09e0b-aa78-4b2b-ac8f-b7db33b8b006 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:31.450080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e09e0b-aa78-4b2b-ac8f-b7db33b8b006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.450755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52047b-7e41-4b41-be62-284449bddcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.451508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e09e0b-aa78-4b2b-ac8f-b7db33b8b006 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.452532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52047b-7e41-4b41-be62-284449bddcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.453003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52047b-7e41-4b41-be62-284449bddcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.453477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52047b-7e41-4b41-be62-284449bddcb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.466144 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52047b-7e41-4b41-be62-284449bddcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.468531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52047b-7e41-4b41-be62-284449bddcb4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-eb52047b-7e41-4b41-be62-284449bddcb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:31.487253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:31.488104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:31.488926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:31.488926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:31.488926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:31.488926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:31.489131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 240/495] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.489761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09e0b-aa78-4b2b-ac8f-b7db33b8b006 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.491107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 256/496] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:31.492537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb865-1300-4913-99b3-9541b9997a3d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.493024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb865-1300-4913-99b3-9541b9997a3d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.493509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb865-1300-4913-99b3-9541b9997a3d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.495204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 257/497] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:31.496102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb865-1300-4913-99b3-9541b9997a3d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.593515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09e0b-aa78-4b2b-ac8f-b7db33b8b006 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.601148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb865-1300-4913-99b3-9541b9997a3d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.626958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2ed7-0777-48cd-ab8a-ce39ef4e5f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.627657 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2ed7-0777-48cd-ab8a-ce39ef4e5f25 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.627944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2ed7-0777-48cd-ab8a-ce39ef4e5f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.628225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2ed7-0777-48cd-ab8a-ce39ef4e5f25 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.628999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2ed7-0777-48cd-ab8a-ce39ef4e5f25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:31.629309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2ed7-0777-48cd-ab8a-ce39ef4e5f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.630680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2ed7-0777-48cd-ab8a-ce39ef4e5f25 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.633469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a344aa2-71df-44a8-afd1-ced498cce243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.634103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344aa2-71df-44a8-afd1-ced498cce243 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.634382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344aa2-71df-44a8-afd1-ced498cce243 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.634653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344aa2-71df-44a8-afd1-ced498cce243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.643489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 241/498] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.643489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2ed7-0777-48cd-ab8a-ce39ef4e5f25 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.649460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.656646 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.701593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a344aa2-71df-44a8-afd1-ced498cce243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.703596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a344aa2-71df-44a8-afd1-ced498cce243 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.740814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2ed7-0777-48cd-ab8a-ce39ef4e5f25 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.808104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 258/499] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:31.809463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e78ea4-9da7-4fc7-874f-0b496bcde82e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.809750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e78ea4-9da7-4fc7-874f-0b496bcde82e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.810028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e78ea4-9da7-4fc7-874f-0b496bcde82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.828810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-83e78ea4-9da7-4fc7-874f-0b496bcde82e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:31.830010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-83e78ea4-9da7-4fc7-874f-0b496bcde82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:31.872606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.895918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a34f3-7d33-4897-a2f4-95c4c74c6cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.896575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a34f3-7d33-4897-a2f4-95c4c74c6cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.896852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a34f3-7d33-4897-a2f4-95c4c74c6cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.897128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a34f3-7d33-4897-a2f4-95c4c74c6cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.897842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a34f3-7d33-4897-a2f4-95c4c74c6cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:31.898148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a34f3-7d33-4897-a2f4-95c4c74c6cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.899214 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 259/500] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:31.899573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a34f3-7d33-4897-a2f4-95c4c74c6cb5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.900589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6572d1b-5dcd-40f2-a983-cab028144902 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.901388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6572d1b-5dcd-40f2-a983-cab028144902 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.901895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6572d1b-5dcd-40f2-a983-cab028144902 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.903493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 260/501] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:31.904195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6572d1b-5dcd-40f2-a983-cab028144902 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.912459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 242/502] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.913448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a34f3-7d33-4897-a2f4-95c4c74c6cb5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.981232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.009542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a34f3-7d33-4897-a2f4-95c4c74c6cb5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.011720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6572d1b-5dcd-40f2-a983-cab028144902 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.042837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae446601-b144-4bcc-99ef-713c72244e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.043644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae446601-b144-4bcc-99ef-713c72244e61 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.043921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae446601-b144-4bcc-99ef-713c72244e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.044192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae446601-b144-4bcc-99ef-713c72244e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.045408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4812c7-6d7c-444c-a194-5dbe765abafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.046189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4812c7-6d7c-444c-a194-5dbe765abafe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.046469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4812c7-6d7c-444c-a194-5dbe765abafe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.046749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4812c7-6d7c-444c-a194-5dbe765abafe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.053956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae446601-b144-4bcc-99ef-713c72244e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.055463 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae446601-b144-4bcc-99ef-713c72244e61 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.056524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4812c7-6d7c-444c-a194-5dbe765abafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.057945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4812c7-6d7c-444c-a194-5dbe765abafe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ae446601-b144-4bcc-99ef-713c72244e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:32.073890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.074754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.075633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:32.075633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:32.075633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:32.075633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:32.075633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 243/503] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5f4812c7-6d7c-444c-a194-5dbe765abafe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:32.075899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.076687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.078111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:32.078111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:32.078111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:32.078111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:32.078314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774adcb-908f-4330-96e7-d8f8956f5b65 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.078314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774adcb-908f-4330-96e7-d8f8956f5b65 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.078440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 261/504] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.078440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4812c7-6d7c-444c-a194-5dbe765abafe None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.081829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774adcb-908f-4330-96e7-d8f8956f5b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.098001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0774adcb-908f-4330-96e7-d8f8956f5b65 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:32.099200 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0774adcb-908f-4330-96e7-d8f8956f5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:32.105132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.166532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 244/505] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:32.167496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774adcb-908f-4330-96e7-d8f8956f5b65 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.193990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4812c7-6d7c-444c-a194-5dbe765abafe None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.220245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.228769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e629a-0d15-4367-a81b-84d92ce0b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.229595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e629a-0d15-4367-a81b-84d92ce0b217 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.229874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e629a-0d15-4367-a81b-84d92ce0b217 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.230145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e629a-0d15-4367-a81b-84d92ce0b217 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.237700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e629a-0d15-4367-a81b-84d92ce0b217 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.239143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e629a-0d15-4367-a81b-84d92ce0b217 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7e1e629a-0d15-4367-a81b-84d92ce0b217 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:32.255433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.256493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 262/506] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.257425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e629a-0d15-4367-a81b-84d92ce0b217 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.273693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774adcb-908f-4330-96e7-d8f8956f5b65 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.306901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7a266-eb48-445c-819f-9231f25cb278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.307731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7a266-eb48-445c-819f-9231f25cb278 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.308013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7a266-eb48-445c-819f-9231f25cb278 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.308284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7a266-eb48-445c-819f-9231f25cb278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.319316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7a266-eb48-445c-819f-9231f25cb278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.320755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7a266-eb48-445c-819f-9231f25cb278 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d8d7a266-eb48-445c-819f-9231f25cb278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:32.337677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.338541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.339434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:32.339434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:32.339434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:32.339434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:32.339434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 245/507] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.339738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7a266-eb48-445c-819f-9231f25cb278 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.344981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.360802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e629a-0d15-4367-a81b-84d92ce0b217 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.395241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b61f25-8b3c-4051-8ea8-78484289a1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.395899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b61f25-8b3c-4051-8ea8-78484289a1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.396181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b61f25-8b3c-4051-8ea8-78484289a1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.396459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b61f25-8b3c-4051-8ea8-78484289a1f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.397177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b61f25-8b3c-4051-8ea8-78484289a1f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:32.397484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b61f25-8b3c-4051-8ea8-78484289a1f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.398840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b61f25-8b3c-4051-8ea8-78484289a1f6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.410157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 263/508] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:32.410945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b61f25-8b3c-4051-8ea8-78484289a1f6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.441116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7a266-eb48-445c-819f-9231f25cb278 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.448284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.475598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff1d2-efa3-4313-9319-e6f4f7c0164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.476257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff1d2-efa3-4313-9319-e6f4f7c0164d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.476539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff1d2-efa3-4313-9319-e6f4f7c0164d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.476803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff1d2-efa3-4313-9319-e6f4f7c0164d None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.477522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff1d2-efa3-4313-9319-e6f4f7c0164d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:32.477823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff1d2-efa3-4313-9319-e6f4f7c0164d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.479200 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff1d2-efa3-4313-9319-e6f4f7c0164d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.490993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 246/509] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:32.491810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff1d2-efa3-4313-9319-e6f4f7c0164d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.511180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b61f25-8b3c-4051-8ea8-78484289a1f6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.545932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f850f-f92b-452c-b18d-087db8dcb0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.546718 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f850f-f92b-452c-b18d-087db8dcb0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.546993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f850f-f92b-452c-b18d-087db8dcb0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.547294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f850f-f92b-452c-b18d-087db8dcb0c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.556982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f850f-f92b-452c-b18d-087db8dcb0c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-aa2f850f-f92b-452c-b18d-087db8dcb0c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:32.564614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.565483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:32.566277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 264/510] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.566929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f850f-f92b-452c-b18d-087db8dcb0c8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.575480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.593458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff1d2-efa3-4313-9319-e6f4f7c0164d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.626423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acb93d-240b-49cd-915b-d872929823a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.627085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acb93d-240b-49cd-915b-d872929823a2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.627392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acb93d-240b-49cd-915b-d872929823a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.627662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acb93d-240b-49cd-915b-d872929823a2 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.628488 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acb93d-240b-49cd-915b-d872929823a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:32.628794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acb93d-240b-49cd-915b-d872929823a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.630209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acb93d-240b-49cd-915b-d872929823a2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.647077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 247/511] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:32.648058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acb93d-240b-49cd-915b-d872929823a2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.667715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f850f-f92b-452c-b18d-087db8dcb0c8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.676760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.701493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfab132-3653-4964-b1d8-ac1a5e0ae84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.702089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfab132-3653-4964-b1d8-ac1a5e0ae84f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.702371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfab132-3653-4964-b1d8-ac1a5e0ae84f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.702644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfab132-3653-4964-b1d8-ac1a5e0ae84f None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.703459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfab132-3653-4964-b1d8-ac1a5e0ae84f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:32.703762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfab132-3653-4964-b1d8-ac1a5e0ae84f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.705185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfab132-3653-4964-b1d8-ac1a5e0ae84f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.716701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 265/512] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:32.717980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfab132-3653-4964-b1d8-ac1a5e0ae84f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.754589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acb93d-240b-49cd-915b-d872929823a2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.782007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.787610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241a1be-d102-4b74-b005-1016d2e76528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.788491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a1be-d102-4b74-b005-1016d2e76528 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.788717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a1be-d102-4b74-b005-1016d2e76528 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.788986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a1be-d102-4b74-b005-1016d2e76528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.796310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241a1be-d102-4b74-b005-1016d2e76528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.797739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241a1be-d102-4b74-b005-1016d2e76528 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d241a1be-d102-4b74-b005-1016d2e76528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:32.812374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.813296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.814139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:32.814139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:32.814139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:32.814139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:32.814139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:32.814139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:32.814139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:32.814139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:32.814139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 248/513] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.814884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241a1be-d102-4b74-b005-1016d2e76528 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.817814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfab132-3653-4964-b1d8-ac1a5e0ae84f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.852328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadfe95-8f4f-4841-8442-11ff4444aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.853115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadfe95-8f4f-4841-8442-11ff4444aa64 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.853445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadfe95-8f4f-4841-8442-11ff4444aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.853714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadfe95-8f4f-4841-8442-11ff4444aa64 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.861293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadfe95-8f4f-4841-8442-11ff4444aa64 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.862708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadfe95-8f4f-4841-8442-11ff4444aa64 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bfadfe95-8f4f-4841-8442-11ff4444aa64 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:32.876706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.877612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:32.878501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 266/514] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.879063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadfe95-8f4f-4841-8442-11ff4444aa64 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.905369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.921191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241a1be-d102-4b74-b005-1016d2e76528 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.955321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc51b-5d0e-4e8c-9623-beea70be26a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.956184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc51b-5d0e-4e8c-9623-beea70be26a2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.956461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc51b-5d0e-4e8c-9623-beea70be26a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.956736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc51b-5d0e-4e8c-9623-beea70be26a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.957480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc51b-5d0e-4e8c-9623-beea70be26a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:32.957784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc51b-5d0e-4e8c-9623-beea70be26a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.959155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc51b-5d0e-4e8c-9623-beea70be26a2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.966994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 249/515] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:32.968396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc51b-5d0e-4e8c-9623-beea70be26a2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.982477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadfe95-8f4f-4841-8442-11ff4444aa64 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.008382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.017493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf412f-5dd1-4fc7-a7bf-9dc560104431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.018137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf412f-5dd1-4fc7-a7bf-9dc560104431 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.018420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf412f-5dd1-4fc7-a7bf-9dc560104431 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.021218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf412f-5dd1-4fc7-a7bf-9dc560104431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.064061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc51b-5d0e-4e8c-9623-beea70be26a2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.084703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf412f-5dd1-4fc7-a7bf-9dc560104431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.086168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf412f-5dd1-4fc7-a7bf-9dc560104431 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.098071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7150f-f6b0-4e56-b8bb-302a0a6d7fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.098717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7150f-f6b0-4e56-b8bb-302a0a6d7fae None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.098992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7150f-f6b0-4e56-b8bb-302a0a6d7fae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.099286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7150f-f6b0-4e56-b8bb-302a0a6d7fae None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.099983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7150f-f6b0-4e56-b8bb-302a0a6d7fae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.101362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7150f-f6b0-4e56-b8bb-302a0a6d7fae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.182042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 267/516] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:33.182860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf412f-5dd1-4fc7-a7bf-9dc560104431 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.203130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 250/517] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:32 2022] POST /identity/v3/users => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:33.203130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7150f-f6b0-4e56-b8bb-302a0a6d7fae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.203130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.211048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.302574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf412f-5dd1-4fc7-a7bf-9dc560104431 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.316389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7150f-f6b0-4e56-b8bb-302a0a6d7fae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.342133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d256f-f1ba-4691-8b49-428bdadf026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.343064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d256f-f1ba-4691-8b49-428bdadf026f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.343644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d256f-f1ba-4691-8b49-428bdadf026f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.344076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d256f-f1ba-4691-8b49-428bdadf026f None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.345149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d256f-f1ba-4691-8b49-428bdadf026f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:33.345598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d256f-f1ba-4691-8b49-428bdadf026f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.347677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d256f-f1ba-4691-8b49-428bdadf026f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.352548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e134ef-2776-4b88-b0cc-be4096e98b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.353243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e134ef-2776-4b88-b0cc-be4096e98b44 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.353529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e134ef-2776-4b88-b0cc-be4096e98b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.353804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e134ef-2776-4b88-b0cc-be4096e98b44 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.354669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e134ef-2776-4b88-b0cc-be4096e98b44 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:33.354982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e134ef-2776-4b88-b0cc-be4096e98b44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.356471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e134ef-2776-4b88-b0cc-be4096e98b44 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.374231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 268/518] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:33.375561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d256f-f1ba-4691-8b49-428bdadf026f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.376832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 251/519] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:33.377676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e134ef-2776-4b88-b0cc-be4096e98b44 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.445592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.486136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.488225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e134ef-2776-4b88-b0cc-be4096e98b44 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.500736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d256f-f1ba-4691-8b49-428bdadf026f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.531294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f4897-6f3d-41aa-95b9-ebcb3ba3cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.532511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f4897-6f3d-41aa-95b9-ebcb3ba3cc3d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.533056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f4897-6f3d-41aa-95b9-ebcb3ba3cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.533464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f4897-6f3d-41aa-95b9-ebcb3ba3cc3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.534764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6775c-7109-469a-95f2-35490a196cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.535582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6775c-7109-469a-95f2-35490a196cce None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.535864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6775c-7109-469a-95f2-35490a196cce None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.536139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6775c-7109-469a-95f2-35490a196cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.546177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f4897-6f3d-41aa-95b9-ebcb3ba3cc3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.546311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6775c-7109-469a-95f2-35490a196cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.547666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6775c-7109-469a-95f2-35490a196cce None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.548182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f4897-6f3d-41aa-95b9-ebcb3ba3cc3d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-09a6775c-7109-469a-95f2-35490a196cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:33.565834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:33.566866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:33.567865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:33.567865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:33.567865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:33.567865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:33.567865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 269/520] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:33.568183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6775c-7109-469a-95f2-35490a196cce None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c52f4897-6f3d-41aa-95b9-ebcb3ba3cc3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:33.570170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:33.570982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:33.571957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:33.571957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:33.571957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:33.571957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:33.571957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 252/521] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:33.572229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f4897-6f3d-41aa-95b9-ebcb3ba3cc3d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.674900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6775c-7109-469a-95f2-35490a196cce None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.682380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f4897-6f3d-41aa-95b9-ebcb3ba3cc3d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.700120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.710896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc37b9-fc1f-4074-9f69-e76174bdcaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.711594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc37b9-fc1f-4074-9f69-e76174bdcaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.718126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc37b9-fc1f-4074-9f69-e76174bdcaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.718126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc37b9-fc1f-4074-9f69-e76174bdcaf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.718126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc37b9-fc1f-4074-9f69-e76174bdcaf7 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=0b0591179ec144f5a90c9a24205b6b47) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:33.718126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc37b9-fc1f-4074-9f69-e76174bdcaf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.718126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc37b9-fc1f-4074-9f69-e76174bdcaf7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.726114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 270/522] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/role_assignments?user.id=0b0591179ec144f5a90c9a24205b6b47&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:33.726114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc37b9-fc1f-4074-9f69-e76174bdcaf7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.727454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef07ec-12c1-4a58-974f-400150d3fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.728139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef07ec-12c1-4a58-974f-400150d3fb3e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.728420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef07ec-12c1-4a58-974f-400150d3fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.728694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef07ec-12c1-4a58-974f-400150d3fb3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.729299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.815115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef07ec-12c1-4a58-974f-400150d3fb3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.816594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef07ec-12c1-4a58-974f-400150d3fb3e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.870268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc37b9-fc1f-4074-9f69-e76174bdcaf7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.909797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c141-4f35-416e-8791-3746c161aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.910590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c141-4f35-416e-8791-3746c161aea0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.910948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c141-4f35-416e-8791-3746c161aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.911344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c141-4f35-416e-8791-3746c161aea0 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.912166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c141-4f35-416e-8791-3746c161aea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:33.912625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c141-4f35-416e-8791-3746c161aea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.914136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c141-4f35-416e-8791-3746c161aea0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.927999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 271/523] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:33.929133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c141-4f35-416e-8791-3746c161aea0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.932319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 253/524] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:33.933253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef07ec-12c1-4a58-974f-400150d3fb3e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.948107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.002377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.042430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c141-4f35-416e-8791-3746c161aea0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.069865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef07ec-12c1-4a58-974f-400150d3fb3e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.083183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d502b-c299-4a47-b566-1cc1d8734f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.084206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d502b-c299-4a47-b566-1cc1d8734f99 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.084689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d502b-c299-4a47-b566-1cc1d8734f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.085161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d502b-c299-4a47-b566-1cc1d8734f99 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.086081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d502b-c299-4a47-b566-1cc1d8734f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:34.086584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d502b-c299-4a47-b566-1cc1d8734f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.088208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d502b-c299-4a47-b566-1cc1d8734f99 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.106984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 272/525] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:34.110325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23e44b-31cb-42a9-81ce-8c38a0aceafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.111397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23e44b-31cb-42a9-81ce-8c38a0aceafe None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.111794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d502b-c299-4a47-b566-1cc1d8734f99 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.112132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23e44b-31cb-42a9-81ce-8c38a0aceafe None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.112604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23e44b-31cb-42a9-81ce-8c38a0aceafe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.123796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23e44b-31cb-42a9-81ce-8c38a0aceafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.125683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23e44b-31cb-42a9-81ce-8c38a0aceafe None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-7a23e44b-31cb-42a9-81ce-8c38a0aceafe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:34.144425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:34.145296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:34.146224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:34.146224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:34.146224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:34.146224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:34.148142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 254/526] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:34.149238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23e44b-31cb-42a9-81ce-8c38a0aceafe None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.219539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.247425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d502b-c299-4a47-b566-1cc1d8734f99 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.259260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23e44b-31cb-42a9-81ce-8c38a0aceafe None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.283707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.297284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512de48-db3f-4371-928b-34761388c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.298477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512de48-db3f-4371-928b-34761388c96e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.299004 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512de48-db3f-4371-928b-34761388c96e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.299559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512de48-db3f-4371-928b-34761388c96e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.305888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bc31a-ee4d-4adc-bc63-88efb24ec5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.306685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bc31a-ee4d-4adc-bc63-88efb24ec5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.306988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bc31a-ee4d-4adc-bc63-88efb24ec5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.307421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bc31a-ee4d-4adc-bc63-88efb24ec5d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.308299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512de48-db3f-4371-928b-34761388c96e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.310089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512de48-db3f-4371-928b-34761388c96e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.315982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bc31a-ee4d-4adc-bc63-88efb24ec5d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.317685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bc31a-ee4d-4adc-bc63-88efb24ec5d5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3512de48-db3f-4371-928b-34761388c96e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:34.328337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:34.329183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:34.330039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:34.330039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:34.330039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:34.330039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:34.330039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:34.330039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:34.330039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:34.330039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:34.332605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 273/527] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-286bc31a-ee4d-4adc-bc63-88efb24ec5d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:34.333586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:34.334442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:34.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 255/528] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:34.337355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512de48-db3f-4371-928b-34761388c96e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.339915 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bc31a-ee4d-4adc-bc63-88efb24ec5d5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.455690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512de48-db3f-4371-928b-34761388c96e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.461803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bc31a-ee4d-4adc-bc63-88efb24ec5d5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.491026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.502223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b2ccd-6d3e-4893-9e58-ee2e1ce744e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.502958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b2ccd-6d3e-4893-9e58-ee2e1ce744e2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.510017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88527599-c87a-4849-8919-b31ec4ba59f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.510175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b2ccd-6d3e-4893-9e58-ee2e1ce744e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.510175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b2ccd-6d3e-4893-9e58-ee2e1ce744e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.510332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88527599-c87a-4849-8919-b31ec4ba59f2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.510332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88527599-c87a-4849-8919-b31ec4ba59f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.510332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88527599-c87a-4849-8919-b31ec4ba59f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.510521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b2ccd-6d3e-4893-9e58-ee2e1ce744e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:34.510521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b2ccd-6d3e-4893-9e58-ee2e1ce744e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.510649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88527599-c87a-4849-8919-b31ec4ba59f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:34.510649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88527599-c87a-4849-8919-b31ec4ba59f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.510771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b2ccd-6d3e-4893-9e58-ee2e1ce744e2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.510845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88527599-c87a-4849-8919-b31ec4ba59f2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.522779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 274/529] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:34.523706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b2ccd-6d3e-4893-9e58-ee2e1ce744e2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.525256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 256/530] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:34.526103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88527599-c87a-4849-8919-b31ec4ba59f2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.569768 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.630298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b2ccd-6d3e-4893-9e58-ee2e1ce744e2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.630935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88527599-c87a-4849-8919-b31ec4ba59f2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.664981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29060a-c620-4ebb-97a1-6b0ddb4103f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.665883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29060a-c620-4ebb-97a1-6b0ddb4103f8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.666307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29060a-c620-4ebb-97a1-6b0ddb4103f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.666736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29060a-c620-4ebb-97a1-6b0ddb4103f8 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.667687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf412a-92c3-481d-9df9-24fd6bc5e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.667927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29060a-c620-4ebb-97a1-6b0ddb4103f8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:34.668387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29060a-c620-4ebb-97a1-6b0ddb4103f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.668508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf412a-92c3-481d-9df9-24fd6bc5e51c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.668747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf412a-92c3-481d-9df9-24fd6bc5e51c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.669024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf412a-92c3-481d-9df9-24fd6bc5e51c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.670869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29060a-c620-4ebb-97a1-6b0ddb4103f8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.676557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf412a-92c3-481d-9df9-24fd6bc5e51c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.677977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf412a-92c3-481d-9df9-24fd6bc5e51c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-82bf412a-92c3-481d-9df9-24fd6bc5e51c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:34.692494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:34.693506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:34.694553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:34.694553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:34.694553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:34.694553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:34.694553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:34.694553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:34.694553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:34.694553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:34.698308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 257/531] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:34.699152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf412a-92c3-481d-9df9-24fd6bc5e51c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.715200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 275/532] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:34.716263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29060a-c620-4ebb-97a1-6b0ddb4103f8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.746263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.803584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf412a-92c3-481d-9df9-24fd6bc5e51c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.818214 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.821856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29060a-c620-4ebb-97a1-6b0ddb4103f8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.839549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274118bd-1318-4fe2-bcf7-137d5bd78713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.840217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274118bd-1318-4fe2-bcf7-137d5bd78713 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.840503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274118bd-1318-4fe2-bcf7-137d5bd78713 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.840780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274118bd-1318-4fe2-bcf7-137d5bd78713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.841616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274118bd-1318-4fe2-bcf7-137d5bd78713 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=bbbc657ed3ae49dc9d45687c5dde2ca1) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:34.842444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274118bd-1318-4fe2-bcf7-137d5bd78713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.844401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274118bd-1318-4fe2-bcf7-137d5bd78713 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.852684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 258/533] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/role_assignments?user.id=bbbc657ed3ae49dc9d45687c5dde2ca1&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:34.853837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274118bd-1318-4fe2-bcf7-137d5bd78713 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.859010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c99ba-d7c7-4064-95e0-a746d4ef2836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.861169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c99ba-d7c7-4064-95e0-a746d4ef2836 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.861701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c99ba-d7c7-4064-95e0-a746d4ef2836 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.862204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c99ba-d7c7-4064-95e0-a746d4ef2836 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.863278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c99ba-d7c7-4064-95e0-a746d4ef2836 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:34.863820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c99ba-d7c7-4064-95e0-a746d4ef2836 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.865515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c99ba-d7c7-4064-95e0-a746d4ef2836 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.879436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 276/534] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:34.891230 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c99ba-d7c7-4064-95e0-a746d4ef2836 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.008837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c99ba-d7c7-4064-95e0-a746d4ef2836 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.054763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ef108-2513-4533-ae73-12a5b57362d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.055462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ef108-2513-4533-ae73-12a5b57362d7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.055745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ef108-2513-4533-ae73-12a5b57362d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.056018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ef108-2513-4533-ae73-12a5b57362d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.056859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ef108-2513-4533-ae73-12a5b57362d7 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=a75463d1b7714510b3898b7fe05baf50) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:35.057174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ef108-2513-4533-ae73-12a5b57362d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.058620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ef108-2513-4533-ae73-12a5b57362d7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.083575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 277/535] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/role_assignments?user.id=a75463d1b7714510b3898b7fe05baf50&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:35.102987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274118bd-1318-4fe2-bcf7-137d5bd78713 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.124362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.146310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e69b2-bdc3-4c48-a795-800fa8dd1877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.146901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e69b2-bdc3-4c48-a795-800fa8dd1877 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.147219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e69b2-bdc3-4c48-a795-800fa8dd1877 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.147501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e69b2-bdc3-4c48-a795-800fa8dd1877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.229591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e69b2-bdc3-4c48-a795-800fa8dd1877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.231080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e69b2-bdc3-4c48-a795-800fa8dd1877 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.339470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 259/536] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:35.348307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ef108-2513-4533-ae73-12a5b57362d7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.408049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.487132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ef108-2513-4533-ae73-12a5b57362d7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.535827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02add1ec-c518-4c02-861d-5139e93ce720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.537036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02add1ec-c518-4c02-861d-5139e93ce720 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.537527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02add1ec-c518-4c02-861d-5139e93ce720 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.538017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02add1ec-c518-4c02-861d-5139e93ce720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.549438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02add1ec-c518-4c02-861d-5139e93ce720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.551214 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02add1ec-c518-4c02-861d-5139e93ce720 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.586227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c888c-2b95-4804-b1fd-0f64c0f5624c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.586545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c888c-2b95-4804-b1fd-0f64c0f5624c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.586783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c888c-2b95-4804-b1fd-0f64c0f5624c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-02add1ec-c518-4c02-861d-5139e93ce720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:35.587511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:35.588322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:35.589726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:35.589726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:35.589726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:35.589726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:35.589938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 260/537] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:35.591733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 278/538] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:35.593613 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d30b0-7aef-42cc-9530-6285139aad70 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.593899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d30b0-7aef-42cc-9530-6285139aad70 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.594170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d30b0-7aef-42cc-9530-6285139aad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.600028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02add1ec-c518-4c02-861d-5139e93ce720 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.632185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-034d30b0-7aef-42cc-9530-6285139aad70 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:35.633607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-034d30b0-7aef-42cc-9530-6285139aad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:35.637120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.687971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.712923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02add1ec-c518-4c02-861d-5139e93ce720 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.767949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33aa64-ded6-4706-804d-1f858d785cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.768615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33aa64-ded6-4706-804d-1f858d785cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.768895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33aa64-ded6-4706-804d-1f858d785cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.769165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33aa64-ded6-4706-804d-1f858d785cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.769892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33aa64-ded6-4706-804d-1f858d785cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:35.770199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33aa64-ded6-4706-804d-1f858d785cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.771616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33aa64-ded6-4706-804d-1f858d785cb8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.786892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 279/539] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:35.789450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 261/540] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:35.800105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33aa64-ded6-4706-804d-1f858d785cb8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.814689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d30b0-7aef-42cc-9530-6285139aad70 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.008679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d30b0-7aef-42cc-9530-6285139aad70 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.046076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33aa64-ded6-4706-804d-1f858d785cb8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.051272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf460732-67b4-4156-86f0-f27a3430862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.052077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf460732-67b4-4156-86f0-f27a3430862b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.052355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf460732-67b4-4156-86f0-f27a3430862b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.052625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf460732-67b4-4156-86f0-f27a3430862b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.071430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.076014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf460732-67b4-4156-86f0-f27a3430862b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-cf460732-67b4-4156-86f0-f27a3430862b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:36.083717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:36.093346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:36.094212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 262/541] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:36.097771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf460732-67b4-4156-86f0-f27a3430862b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.124388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f307837-edb1-4c37-bee7-47972bd5abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.125188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f307837-edb1-4c37-bee7-47972bd5abc2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.125467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f307837-edb1-4c37-bee7-47972bd5abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.125737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f307837-edb1-4c37-bee7-47972bd5abc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.130105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.142274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f307837-edb1-4c37-bee7-47972bd5abc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.144060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f307837-edb1-4c37-bee7-47972bd5abc2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6f307837-edb1-4c37-bee7-47972bd5abc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:36.167606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:36.168486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:36.169315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:36.169315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:36.169315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:36.169315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:36.169315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:36.169315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:36.169315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:36.169315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:36.169315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 280/542] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:36.176282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f307837-edb1-4c37-bee7-47972bd5abc2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.236880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf460732-67b4-4156-86f0-f27a3430862b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.283975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a1360-02f2-4f54-a5a3-18fec0dff60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.284838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a1360-02f2-4f54-a5a3-18fec0dff60e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.285266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a1360-02f2-4f54-a5a3-18fec0dff60e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.285710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a1360-02f2-4f54-a5a3-18fec0dff60e None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.286602 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a1360-02f2-4f54-a5a3-18fec0dff60e None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:36.287052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a1360-02f2-4f54-a5a3-18fec0dff60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.288577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a1360-02f2-4f54-a5a3-18fec0dff60e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.298875 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 263/543] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:36.300432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7761-1727-44d1-b8cf-b2510c3bced4 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.300875 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7761-1727-44d1-b8cf-b2510c3bced4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.301294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7761-1727-44d1-b8cf-b2510c3bced4 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.303002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 264/544] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:36.304092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b7761-1727-44d1-b8cf-b2510c3bced4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.322040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f307837-edb1-4c37-bee7-47972bd5abc2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.358189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e3b7c-08c7-4ad2-befb-6e28542657e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.358850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e3b7c-08c7-4ad2-befb-6e28542657e7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.359149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e3b7c-08c7-4ad2-befb-6e28542657e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.359426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e3b7c-08c7-4ad2-befb-6e28542657e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.360207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e3b7c-08c7-4ad2-befb-6e28542657e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:36.360500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e3b7c-08c7-4ad2-befb-6e28542657e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.361909 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e3b7c-08c7-4ad2-befb-6e28542657e7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.371730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.374766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 281/545] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:36.376335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934a7d-c2d0-4c57-ba6b-520e6e492257 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.376471 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934a7d-c2d0-4c57-ba6b-520e6e492257 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.376692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934a7d-c2d0-4c57-ba6b-520e6e492257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.393615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9a934a7d-c2d0-4c57-ba6b-520e6e492257 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:36.394796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9a934a7d-c2d0-4c57-ba6b-520e6e492257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:36.417652 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b7761-1727-44d1-b8cf-b2510c3bced4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.449043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.453709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511702-5102-49d5-b125-0b8bdb92c4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.454633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511702-5102-49d5-b125-0b8bdb92c4bb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.455071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511702-5102-49d5-b125-0b8bdb92c4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.455469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511702-5102-49d5-b125-0b8bdb92c4bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.468512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 282/546] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:36.469553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934a7d-c2d0-4c57-ba6b-520e6e492257 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.470676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad511702-5102-49d5-b125-0b8bdb92c4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.472774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad511702-5102-49d5-b125-0b8bdb92c4bb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ad511702-5102-49d5-b125-0b8bdb92c4bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:36.495230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:36.496186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:36.497001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:36.497001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:36.497001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:36.497001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:36.497209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 265/547] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:36.500241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511702-5102-49d5-b125-0b8bdb92c4bb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.589498 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934a7d-c2d0-4c57-ba6b-520e6e492257 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.628902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692c086-3cf4-479f-b1a3-02142173a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.629857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692c086-3cf4-479f-b1a3-02142173a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.630294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511702-5102-49d5-b125-0b8bdb92c4bb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.630935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692c086-3cf4-479f-b1a3-02142173a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.631496 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692c086-3cf4-479f-b1a3-02142173a1f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.632607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692c086-3cf4-479f-b1a3-02142173a1f1 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=4bc0ef455caa4ee5b6b86dc1904d4e24) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:36.633144 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692c086-3cf4-479f-b1a3-02142173a1f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.634584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692c086-3cf4-479f-b1a3-02142173a1f1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.641503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 283/548] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/role_assignments?user.id=4bc0ef455caa4ee5b6b86dc1904d4e24&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:36.642161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692c086-3cf4-479f-b1a3-02142173a1f1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.647315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.681254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b1243-4036-4205-a7c9-12752e367bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.682082 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b1243-4036-4205-a7c9-12752e367bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.682403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b1243-4036-4205-a7c9-12752e367bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.682747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b1243-4036-4205-a7c9-12752e367bb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.703253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b1243-4036-4205-a7c9-12752e367bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-281b1243-4036-4205-a7c9-12752e367bb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:36.721673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:36.722834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:36.723673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:36.729201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 266/549] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:36.738144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b1243-4036-4205-a7c9-12752e367bb0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.767082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.844164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692c086-3cf4-479f-b1a3-02142173a1f1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.898018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6998-77cb-4ab5-bb14-674e8f741a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.898792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6998-77cb-4ab5-bb14-674e8f741a4d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.899078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6998-77cb-4ab5-bb14-674e8f741a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.899384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6998-77cb-4ab5-bb14-674e8f741a4d None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.900106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd6998-77cb-4ab5-bb14-674e8f741a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:36.900414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd6998-77cb-4ab5-bb14-674e8f741a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.902040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd6998-77cb-4ab5-bb14-674e8f741a4d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.916266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 284/550] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:36.919557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b1243-4036-4205-a7c9-12752e367bb0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.922331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6998-77cb-4ab5-bb14-674e8f741a4d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.975455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bacfbb-8bc2-4ba3-bf15-cd397d862312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.976143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bacfbb-8bc2-4ba3-bf15-cd397d862312 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.976424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bacfbb-8bc2-4ba3-bf15-cd397d862312 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.976698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bacfbb-8bc2-4ba3-bf15-cd397d862312 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.977454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bacfbb-8bc2-4ba3-bf15-cd397d862312 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:36.977766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bacfbb-8bc2-4ba3-bf15-cd397d862312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.979151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bacfbb-8bc2-4ba3-bf15-cd397d862312 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.001945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 267/551] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:37.007401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bacfbb-8bc2-4ba3-bf15-cd397d862312 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.046519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.106286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6998-77cb-4ab5-bb14-674e8f741a4d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.127324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bacfbb-8bc2-4ba3-bf15-cd397d862312 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.128140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.142880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750dc13-c708-4495-8d57-5387adb49908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.143704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750dc13-c708-4495-8d57-5387adb49908 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.144250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750dc13-c708-4495-8d57-5387adb49908 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.144534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750dc13-c708-4495-8d57-5387adb49908 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.152352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750dc13-c708-4495-8d57-5387adb49908 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.153875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750dc13-c708-4495-8d57-5387adb49908 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.167627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc3e99-2fc1-49f5-94b0-998a50cbdac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.168461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3e99-2fc1-49f5-94b0-998a50cbdac6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.168742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3e99-2fc1-49f5-94b0-998a50cbdac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.169014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3e99-2fc1-49f5-94b0-998a50cbdac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f750dc13-c708-4495-8d57-5387adb49908 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:37.170752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:37.172577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:37.174360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 285/552] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:37.183138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750dc13-c708-4495-8d57-5387adb49908 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.183307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc3e99-2fc1-49f5-94b0-998a50cbdac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.183426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc3e99-2fc1-49f5-94b0-998a50cbdac6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d1fc3e99-2fc1-49f5-94b0-998a50cbdac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:37.208007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:37.209130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:37.210227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:37.210227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:37.210227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:37.210227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:37.210227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 268/553] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:37.215353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc3e99-2fc1-49f5-94b0-998a50cbdac6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.292956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750dc13-c708-4495-8d57-5387adb49908 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.304458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.320173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc3e99-2fc1-49f5-94b0-998a50cbdac6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.331829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d261-bca2-472b-a986-b302a63e2d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.332603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d261-bca2-472b-a986-b302a63e2d9d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.332953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d261-bca2-472b-a986-b302a63e2d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.333296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d261-bca2-472b-a986-b302a63e2d9d None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.334212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69d261-bca2-472b-a986-b302a63e2d9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:37.334599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69d261-bca2-472b-a986-b302a63e2d9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.336140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69d261-bca2-472b-a986-b302a63e2d9d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.356077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 286/554] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:37.364387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d261-bca2-472b-a986-b302a63e2d9d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.393962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad2529-4372-47e7-89be-48d012f7766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.394691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad2529-4372-47e7-89be-48d012f7766e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.394975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad2529-4372-47e7-89be-48d012f7766e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.395272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad2529-4372-47e7-89be-48d012f7766e None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.397208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad2529-4372-47e7-89be-48d012f7766e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:37.397520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad2529-4372-47e7-89be-48d012f7766e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.398898 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad2529-4372-47e7-89be-48d012f7766e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.427449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.427826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 269/555] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:37.432952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad2529-4372-47e7-89be-48d012f7766e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.547587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d261-bca2-472b-a986-b302a63e2d9d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.551186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad2529-4372-47e7-89be-48d012f7766e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.586140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78488839-aaf1-4ae2-bb3d-b7113f96d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.586938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78488839-aaf1-4ae2-bb3d-b7113f96d498 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.587268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78488839-aaf1-4ae2-bb3d-b7113f96d498 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.587543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78488839-aaf1-4ae2-bb3d-b7113f96d498 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.595051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78488839-aaf1-4ae2-bb3d-b7113f96d498 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.596782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78488839-aaf1-4ae2-bb3d-b7113f96d498 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.615166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efdd92-1e1d-4f47-a169-47fa61afcd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.615758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efdd92-1e1d-4f47-a169-47fa61afcd6a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.616045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efdd92-1e1d-4f47-a169-47fa61afcd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.616323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efdd92-1e1d-4f47-a169-47fa61afcd6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-78488839-aaf1-4ae2-bb3d-b7113f96d498 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:37.627018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:37.627979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:37.629380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:37.630601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 270/556] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:37.635156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78488839-aaf1-4ae2-bb3d-b7113f96d498 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.650263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.709096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efdd92-1e1d-4f47-a169-47fa61afcd6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.710656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efdd92-1e1d-4f47-a169-47fa61afcd6a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.739986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.753179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78488839-aaf1-4ae2-bb3d-b7113f96d498 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.791457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5114f89-bf4a-42b3-8d02-41fe6d61b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.792246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5114f89-bf4a-42b3-8d02-41fe6d61b400 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.792531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5114f89-bf4a-42b3-8d02-41fe6d61b400 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.792805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5114f89-bf4a-42b3-8d02-41fe6d61b400 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.793652 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5114f89-bf4a-42b3-8d02-41fe6d61b400 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:37.793961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5114f89-bf4a-42b3-8d02-41fe6d61b400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.796061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5114f89-bf4a-42b3-8d02-41fe6d61b400 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.816061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 271/557] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:37.817714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81056-e1fd-402c-96df-f5a9c99d499d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.818003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81056-e1fd-402c-96df-f5a9c99d499d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.818276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f81056-e1fd-402c-96df-f5a9c99d499d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.819822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 272/558] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:37.820899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166ea2-4121-438b-916b-9ba519d1c6d2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.821180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166ea2-4121-438b-916b-9ba519d1c6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.821451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166ea2-4121-438b-916b-9ba519d1c6d2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.822784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 273/559] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:37.824128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 287/560] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:54:37.827666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40166ea2-4121-438b-916b-9ba519d1c6d2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.827909 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efdd92-1e1d-4f47-a169-47fa61afcd6a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.898106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.982038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40166ea2-4121-438b-916b-9ba519d1c6d2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.983515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efdd92-1e1d-4f47-a169-47fa61afcd6a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.012978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.017428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a7c1-cec5-4afa-a169-18cfeccb620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.018219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a7c1-cec5-4afa-a169-18cfeccb620f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.018506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a7c1-cec5-4afa-a169-18cfeccb620f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.018776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a7c1-cec5-4afa-a169-18cfeccb620f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.021573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a8ba7-e247-446c-b9e1-a237cb7e3cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.028637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a8ba7-e247-446c-b9e1-a237cb7e3cfb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.028637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a8ba7-e247-446c-b9e1-a237cb7e3cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.028637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a8ba7-e247-446c-b9e1-a237cb7e3cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.030351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6a7c1-cec5-4afa-a169-18cfeccb620f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.031809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6a7c1-cec5-4afa-a169-18cfeccb620f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.033494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a8ba7-e247-446c-b9e1-a237cb7e3cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.034978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a8ba7-e247-446c-b9e1-a237cb7e3cfb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-50b6a7c1-cec5-4afa-a169-18cfeccb620f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:38.049949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:38.050863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:38.051786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:38.051786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:38.051786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:38.051786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:38.051786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 274/561] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:38.052650 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566548-1065-431d-9000-58a4ee6e2bc3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.052932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566548-1065-431d-9000-58a4ee6e2bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.053203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85566548-1065-431d-9000-58a4ee6e2bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9a2a8ba7-e247-446c-b9e1-a237cb7e3cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:38.058202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:38.059259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:38.060145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:38.060145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:38.060145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:38.060145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:38.060844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 288/562] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:38.062221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6bfae-4fde-493d-a48c-5213874b0dee None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.062509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6bfae-4fde-493d-a48c-5213874b0dee None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.062786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6bfae-4fde-493d-a48c-5213874b0dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.073636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-85566548-1065-431d-9000-58a4ee6e2bc3 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:38.075049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-85566548-1065-431d-9000-58a4ee6e2bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:38.080206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5fc6bfae-4fde-493d-a48c-5213874b0dee None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:38.081403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5fc6bfae-4fde-493d-a48c-5213874b0dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:38.159160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 275/563] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:38.159160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85566548-1065-431d-9000-58a4ee6e2bc3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.171229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 289/564] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:38.172113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6bfae-4fde-493d-a48c-5213874b0dee None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.222255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.275844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85566548-1065-431d-9000-58a4ee6e2bc3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.294436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6bfae-4fde-493d-a48c-5213874b0dee None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.306577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.311077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56a820-c52c-4650-8431-55a4212e050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.311774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56a820-c52c-4650-8431-55a4212e050e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.312052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56a820-c52c-4650-8431-55a4212e050e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.312321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56a820-c52c-4650-8431-55a4212e050e None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.313037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56a820-c52c-4650-8431-55a4212e050e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:38.313340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56a820-c52c-4650-8431-55a4212e050e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.314775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56a820-c52c-4650-8431-55a4212e050e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.326619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 276/565] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:38.328406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56a820-c52c-4650-8431-55a4212e050e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.333080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc85f-fc84-47a8-8500-01109104106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.333244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc85f-fc84-47a8-8500-01109104106c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.333395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc85f-fc84-47a8-8500-01109104106c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.333660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc85f-fc84-47a8-8500-01109104106c None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.334384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcc85f-fc84-47a8-8500-01109104106c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:38.334688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcc85f-fc84-47a8-8500-01109104106c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.336087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcc85f-fc84-47a8-8500-01109104106c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.348999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 290/566] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:38.349945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc85f-fc84-47a8-8500-01109104106c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.442187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56a820-c52c-4650-8431-55a4212e050e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.449803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.453394 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc85f-fc84-47a8-8500-01109104106c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.481165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ef6c-8616-4930-829c-117d5dd74432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.482568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ef6c-8616-4930-829c-117d5dd74432 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.483256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ef6c-8616-4930-829c-117d5dd74432 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.483849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ef6c-8616-4930-829c-117d5dd74432 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.489511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d147cf-e4cc-4dc7-873f-2f5671e93e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.490304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d147cf-e4cc-4dc7-873f-2f5671e93e98 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.490590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d147cf-e4cc-4dc7-873f-2f5671e93e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.490866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d147cf-e4cc-4dc7-873f-2f5671e93e98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.495663 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903ef6c-8616-4930-829c-117d5dd74432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:38.501436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d147cf-e4cc-4dc7-873f-2f5671e93e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8903ef6c-8616-4930-829c-117d5dd74432 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:38.503388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:38.504267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:38.505116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e1d147cf-e4cc-4dc7-873f-2f5671e93e98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:38.509281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:38.510158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:38.512324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:38.514382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 277/567] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:38.514382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ef6c-8616-4930-829c-117d5dd74432 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.514663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 291/568] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:38.514663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d147cf-e4cc-4dc7-873f-2f5671e93e98 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.542947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.617864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d147cf-e4cc-4dc7-873f-2f5671e93e98 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.623547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ef6c-8616-4930-829c-117d5dd74432 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.655323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dac68-61c7-4fcd-a6db-93f47948bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.656633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dac68-61c7-4fcd-a6db-93f47948bdad None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.657171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dac68-61c7-4fcd-a6db-93f47948bdad None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.657653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dac68-61c7-4fcd-a6db-93f47948bdad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.659487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6819e9-386e-4725-a0d5-1fdecc19a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.660651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6819e9-386e-4725-a0d5-1fdecc19a95b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.660960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6819e9-386e-4725-a0d5-1fdecc19a95b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.661235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6819e9-386e-4725-a0d5-1fdecc19a95b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.664948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dac68-61c7-4fcd-a6db-93f47948bdad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.666403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dac68-61c7-4fcd-a6db-93f47948bdad None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.668261 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6819e9-386e-4725-a0d5-1fdecc19a95b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.669831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6819e9-386e-4725-a0d5-1fdecc19a95b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ed7dac68-61c7-4fcd-a6db-93f47948bdad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:38.681157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:38.682049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 292/569] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:38.688395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dac68-61c7-4fcd-a6db-93f47948bdad None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9b6819e9-386e-4725-a0d5-1fdecc19a95b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:38.688953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:38.689775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:38.690734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:38.690734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:38.690734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:38.690734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:38.690734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:38.690734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:38.690734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:38.690734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:38.690734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 278/570] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:38.693123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6819e9-386e-4725-a0d5-1fdecc19a95b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.719220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.783817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.793637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dac68-61c7-4fcd-a6db-93f47948bdad None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.797220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6819e9-386e-4725-a0d5-1fdecc19a95b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.829527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f354f-9cc9-4bcf-99b7-a06c96260c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.830189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f354f-9cc9-4bcf-99b7-a06c96260c11 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.830464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f354f-9cc9-4bcf-99b7-a06c96260c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.830733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f354f-9cc9-4bcf-99b7-a06c96260c11 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.838482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f354f-9cc9-4bcf-99b7-a06c96260c11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:38.838482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f354f-9cc9-4bcf-99b7-a06c96260c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.838482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f354f-9cc9-4bcf-99b7-a06c96260c11 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.838855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3b482-8494-40b2-9c96-6a1a1a4c42b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.838855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3b482-8494-40b2-9c96-6a1a1a4c42b9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.838855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3b482-8494-40b2-9c96-6a1a1a4c42b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.838855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3b482-8494-40b2-9c96-6a1a1a4c42b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.839277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3b482-8494-40b2-9c96-6a1a1a4c42b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:38.839277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3b482-8494-40b2-9c96-6a1a1a4c42b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.839277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3b482-8494-40b2-9c96-6a1a1a4c42b9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.847840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 293/571] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:38.847840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f354f-9cc9-4bcf-99b7-a06c96260c11 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.851859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 279/572] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:38.856681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3b482-8494-40b2-9c96-6a1a1a4c42b9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.947722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.960036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3b482-8494-40b2-9c96-6a1a1a4c42b9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.966270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f354f-9cc9-4bcf-99b7-a06c96260c11 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.000269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59735e50-8748-464c-95a7-45e5147514c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.000947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735e50-8748-464c-95a7-45e5147514c2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.001199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735e50-8748-464c-95a7-45e5147514c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.001467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735e50-8748-464c-95a7-45e5147514c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.002239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735e50-8748-464c-95a7-45e5147514c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:39.002545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735e50-8748-464c-95a7-45e5147514c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.003895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bceff-cb80-4cf8-a78e-c0b51ba59d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.004012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735e50-8748-464c-95a7-45e5147514c2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.004548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bceff-cb80-4cf8-a78e-c0b51ba59d7a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.004830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bceff-cb80-4cf8-a78e-c0b51ba59d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.005105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bceff-cb80-4cf8-a78e-c0b51ba59d7a None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.005880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bceff-cb80-4cf8-a78e-c0b51ba59d7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:39.006187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bceff-cb80-4cf8-a78e-c0b51ba59d7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.007610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bceff-cb80-4cf8-a78e-c0b51ba59d7a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.020866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 280/573] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:39.020866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59735e50-8748-464c-95a7-45e5147514c2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.024843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 294/574] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:39.025744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bceff-cb80-4cf8-a78e-c0b51ba59d7a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.040140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:39.129881 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bceff-cb80-4cf8-a78e-c0b51ba59d7a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.132354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59735e50-8748-464c-95a7-45e5147514c2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.164599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f957b-d11f-48ca-9b14-060c6ce598fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.165701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f957b-d11f-48ca-9b14-060c6ce598fc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.166181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f957b-d11f-48ca-9b14-060c6ce598fc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.166433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a78a0-88a5-47b7-a265-004e592fea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.166833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f957b-d11f-48ca-9b14-060c6ce598fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.167246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a78a0-88a5-47b7-a265-004e592fea12 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.167523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a78a0-88a5-47b7-a265-004e592fea12 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.167793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a78a0-88a5-47b7-a265-004e592fea12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.178536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a78a0-88a5-47b7-a265-004e592fea12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.180203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a78a0-88a5-47b7-a265-004e592fea12 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.182639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f957b-d11f-48ca-9b14-060c6ce598fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.184086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f957b-d11f-48ca-9b14-060c6ce598fc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.190614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0a0a78a0-88a5-47b7-a265-004e592fea12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:39.204616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:39.205529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:39.211226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:39.211226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:39.211226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:39.211226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:39.211226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 281/575] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:39.211226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a78a0-88a5-47b7-a265-004e592fea12 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b94f957b-d11f-48ca-9b14-060c6ce598fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:39.211622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:39.212451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:39.213332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:39.213332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:39.213332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:39.213332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:39.213332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 295/576] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:39.213332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f957b-d11f-48ca-9b14-060c6ce598fc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.273884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:39.302776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a78a0-88a5-47b7-a265-004e592fea12 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.311359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f957b-d11f-48ca-9b14-060c6ce598fc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.335656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb09b0d-e632-4e00-843b-017a6471c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.336307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09b0d-e632-4e00-843b-017a6471c867 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.336586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09b0d-e632-4e00-843b-017a6471c867 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.336859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09b0d-e632-4e00-843b-017a6471c867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.337682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb09b0d-e632-4e00-843b-017a6471c867 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=ffbe700a0ebc48b5953a600400ecfed5) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:39.337991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb09b0d-e632-4e00-843b-017a6471c867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.339420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb09b0d-e632-4e00-843b-017a6471c867 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.344637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ef30-fd98-4a0a-b87a-8afc85363262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.345272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 282/577] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/role_assignments?user.id=ffbe700a0ebc48b5953a600400ecfed5&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:39.345514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ef30-fd98-4a0a-b87a-8afc85363262 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.346054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ef30-fd98-4a0a-b87a-8afc85363262 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.346327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ef30-fd98-4a0a-b87a-8afc85363262 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/0b0591179ec144f5a90c9a24205b6b47/roles/e8972a7e9ed3405c9912b4d0a12fa6f6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.346729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45e1b-793c-4635-a682-e3d9e097c1b6 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.347009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45e1b-793c-4635-a682-e3d9e097c1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.347316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45e1b-793c-4635-a682-e3d9e097c1b6 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.348698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 283/578] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:39.349244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b45e1b-793c-4635-a682-e3d9e097c1b6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.370379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ef30-fd98-4a0a-b87a-8afc85363262 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=0b0591179ec144f5a90c9a24205b6b47, role_id=e8972a7e9ed3405c9912b4d0a12fa6f6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.371941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ef30-fd98-4a0a-b87a-8afc85363262 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.421909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:39.449648 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 296/579] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:39 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/0b0591179ec144f5a90c9a24205b6b47/roles/e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:39.450934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ef30-fd98-4a0a-b87a-8afc85363262 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.474117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b45e1b-793c-4635-a682-e3d9e097c1b6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.515476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835a73b-aca0-4a8c-8ae3-8dba6c35dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.516164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a73b-aca0-4a8c-8ae3-8dba6c35dc82 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.516444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a73b-aca0-4a8c-8ae3-8dba6c35dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.516717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a73b-aca0-4a8c-8ae3-8dba6c35dc82 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.517518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835a73b-aca0-4a8c-8ae3-8dba6c35dc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:39.517823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835a73b-aca0-4a8c-8ae3-8dba6c35dc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.519477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835a73b-aca0-4a8c-8ae3-8dba6c35dc82 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.538863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 284/580] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:39.540596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027386d-086c-4293-901b-a0ad4d804536 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.540888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027386d-086c-4293-901b-a0ad4d804536 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.541164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027386d-086c-4293-901b-a0ad4d804536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.575125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9027386d-086c-4293-901b-a0ad4d804536 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:39.575125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9027386d-086c-4293-901b-a0ad4d804536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:39.602811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ef30-fd98-4a0a-b87a-8afc85363262 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.620327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:39.643964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f464dd-8c78-4352-b31f-883da2e45335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.644652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f464dd-8c78-4352-b31f-883da2e45335 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.644934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f464dd-8c78-4352-b31f-883da2e45335 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.645212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f464dd-8c78-4352-b31f-883da2e45335 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.645956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f464dd-8c78-4352-b31f-883da2e45335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:39.646332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f464dd-8c78-4352-b31f-883da2e45335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.647925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f464dd-8c78-4352-b31f-883da2e45335 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.663025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 297/581] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:39.663947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f464dd-8c78-4352-b31f-883da2e45335 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.669112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 285/582] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:39.671166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027386d-086c-4293-901b-a0ad4d804536 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.745083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:39.801490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f464dd-8c78-4352-b31f-883da2e45335 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.809043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027386d-086c-4293-901b-a0ad4d804536 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.839260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428008f3-6306-4e29-b994-51e29abf8895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.840115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428008f3-6306-4e29-b994-51e29abf8895 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.840337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428008f3-6306-4e29-b994-51e29abf8895 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.840602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428008f3-6306-4e29-b994-51e29abf8895 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.850199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428008f3-6306-4e29-b994-51e29abf8895 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.851757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428008f3-6306-4e29-b994-51e29abf8895 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.857603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527183-c14b-4bf2-be19-e65be9903caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.858402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527183-c14b-4bf2-be19-e65be9903caf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.858684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527183-c14b-4bf2-be19-e65be9903caf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.869047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527183-c14b-4bf2-be19-e65be9903caf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.869047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527183-c14b-4bf2-be19-e65be9903caf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-428008f3-6306-4e29-b994-51e29abf8895 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:39.869253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:39.870215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:39.871185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:39.871718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527183-c14b-4bf2-be19-e65be9903caf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.873177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 298/583] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:39.874024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428008f3-6306-4e29-b994-51e29abf8895 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-13527183-c14b-4bf2-be19-e65be9903caf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:39.891983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:39.893017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:39.893947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:39.897982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 286/584] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:39.898544 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527183-c14b-4bf2-be19-e65be9903caf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.923507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:40.000887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428008f3-6306-4e29-b994-51e29abf8895 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.021134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527183-c14b-4bf2-be19-e65be9903caf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.038912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:40.043385 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d703b-d922-4456-977c-59a9ce3fab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.044421 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d703b-d922-4456-977c-59a9ce3fab78 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.044969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d703b-d922-4456-977c-59a9ce3fab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.045880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d703b-d922-4456-977c-59a9ce3fab78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.059251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fac2e-3a02-49c7-b012-aa007d89f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.059963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fac2e-3a02-49c7-b012-aa007d89f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.060717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d703b-d922-4456-977c-59a9ce3fab78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:40.060846 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fac2e-3a02-49c7-b012-aa007d89f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.061168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fac2e-3a02-49c7-b012-aa007d89f6d4 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.062083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fac2e-3a02-49c7-b012-aa007d89f6d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:40.062455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fac2e-3a02-49c7-b012-aa007d89f6d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:40.063982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fac2e-3a02-49c7-b012-aa007d89f6d4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7e4d703b-d922-4456-977c-59a9ce3fab78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:40.071487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:40.072405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:40.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:40.077369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 299/585] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:40.078373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d703b-d922-4456-977c-59a9ce3fab78 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:40.089861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 287/586] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:40.090986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fac2e-3a02-49c7-b012-aa007d89f6d4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:40.215356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:40.218969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fac2e-3a02-49c7-b012-aa007d89f6d4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.229033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d703b-d922-4456-977c-59a9ce3fab78 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.258314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05806fb-bbfc-4697-8aca-81c96e9d0004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.258314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05806fb-bbfc-4697-8aca-81c96e9d0004 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.258314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05806fb-bbfc-4697-8aca-81c96e9d0004 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.258314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05806fb-bbfc-4697-8aca-81c96e9d0004 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.258702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05806fb-bbfc-4697-8aca-81c96e9d0004 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:40.258702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05806fb-bbfc-4697-8aca-81c96e9d0004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:40.260063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05806fb-bbfc-4697-8aca-81c96e9d0004 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:40.277580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 288/587] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:40.278933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05806fb-bbfc-4697-8aca-81c96e9d0004 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:40.281976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f2629-d3ba-478d-8a38-d730e319bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.283738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2629-d3ba-478d-8a38-d730e319bceb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.284020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2629-d3ba-478d-8a38-d730e319bceb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.284296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f2629-d3ba-478d-8a38-d730e319bceb None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.285145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f2629-d3ba-478d-8a38-d730e319bceb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:40.285453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f2629-d3ba-478d-8a38-d730e319bceb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:40.286864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f2629-d3ba-478d-8a38-d730e319bceb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:40.309346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 300/588] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:40.310753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f2629-d3ba-478d-8a38-d730e319bceb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:40.326661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:40.411084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05806fb-bbfc-4697-8aca-81c96e9d0004 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.429075 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f2629-d3ba-478d-8a38-d730e319bceb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.445815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c9f0-e977-404e-936c-d9246a2df260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.446660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c9f0-e977-404e-936c-d9246a2df260 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.447023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c9f0-e977-404e-936c-d9246a2df260 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.447273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c9f0-e977-404e-936c-d9246a2df260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.458632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6c9f0-e977-404e-936c-d9246a2df260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:40.460073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6c9f0-e977-404e-936c-d9246a2df260 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:40.474738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163f85-c93a-4c93-8ba0-d75e3ded131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.475975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163f85-c93a-4c93-8ba0-d75e3ded131d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.476462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163f85-c93a-4c93-8ba0-d75e3ded131d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.476934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163f85-c93a-4c93-8ba0-d75e3ded131d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9ba6c9f0-e977-404e-936c-d9246a2df260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:40.479848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:40.480764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:40.481670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:40.481670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:40.481670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:40.481670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:40.485793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 289/589] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:40.486691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c9f0-e977-404e-936c-d9246a2df260 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:40.495580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163f85-c93a-4c93-8ba0-d75e3ded131d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:40.497912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163f85-c93a-4c93-8ba0-d75e3ded131d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-25163f85-c93a-4c93-8ba0-d75e3ded131d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:40.525209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:40.526180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:40.527048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:40.527048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:40.527048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:40.527048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:40.527048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 301/590] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:40.531192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163f85-c93a-4c93-8ba0-d75e3ded131d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:40.535830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:40.598016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:40.617370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c9f0-e977-404e-936c-d9246a2df260 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.642917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163f85-c93a-4c93-8ba0-d75e3ded131d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.661778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795cb8-2a3f-4e6a-8c6c-eeba1368502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.662724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795cb8-2a3f-4e6a-8c6c-eeba1368502c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.663148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795cb8-2a3f-4e6a-8c6c-eeba1368502c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.663523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795cb8-2a3f-4e6a-8c6c-eeba1368502c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.674831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78795cb8-2a3f-4e6a-8c6c-eeba1368502c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:40.676410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78795cb8-2a3f-4e6a-8c6c-eeba1368502c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:40.687041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb8f0-8fb4-4efd-bee0-42f4f36a2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.687733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb8f0-8fb4-4efd-bee0-42f4f36a2b41 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.688012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb8f0-8fb4-4efd-bee0-42f4f36a2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.688285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb8f0-8fb4-4efd-bee0-42f4f36a2b41 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.689004 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb8f0-8fb4-4efd-bee0-42f4f36a2b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:40.689308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb8f0-8fb4-4efd-bee0-42f4f36a2b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:40.690673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb8f0-8fb4-4efd-bee0-42f4f36a2b41 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-78795cb8-2a3f-4e6a-8c6c-eeba1368502c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:40.700509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:40.701933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:40.702827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:40.702827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:40.702827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:40.702827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:40.703478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 302/591] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:40.704187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb8f0-8fb4-4efd-bee0-42f4f36a2b41 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:40.705494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 290/592] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:40.713473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795cb8-2a3f-4e6a-8c6c-eeba1368502c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:40.778424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:40.833179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb8f0-8fb4-4efd-bee0-42f4f36a2b41 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.833906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795cb8-2a3f-4e6a-8c6c-eeba1368502c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:40.871015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071e8a-9f2d-4c9b-97cb-36fc8400c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.871712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071e8a-9f2d-4c9b-97cb-36fc8400c882 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.872018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071e8a-9f2d-4c9b-97cb-36fc8400c882 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.872293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071e8a-9f2d-4c9b-97cb-36fc8400c882 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.873535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071e8a-9f2d-4c9b-97cb-36fc8400c882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:40.873834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071e8a-9f2d-4c9b-97cb-36fc8400c882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:40.875225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071e8a-9f2d-4c9b-97cb-36fc8400c882 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:40.876127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936ec5f-2b99-4e3a-9391-83511f9f785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:40.877106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936ec5f-2b99-4e3a-9391-83511f9f785e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.877953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936ec5f-2b99-4e3a-9391-83511f9f785e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.878300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936ec5f-2b99-4e3a-9391-83511f9f785e None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.879083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936ec5f-2b99-4e3a-9391-83511f9f785e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:40.883641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936ec5f-2b99-4e3a-9391-83511f9f785e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:40.883641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936ec5f-2b99-4e3a-9391-83511f9f785e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:40.883886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:40.893443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 291/593] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:40.894373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071e8a-9f2d-4c9b-97cb-36fc8400c882 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:40.901830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 303/594] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:40.902679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936ec5f-2b99-4e3a-9391-83511f9f785e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.008430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936ec5f-2b99-4e3a-9391-83511f9f785e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.028685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071e8a-9f2d-4c9b-97cb-36fc8400c882 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.039817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.054023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcf07c-5c4d-46fc-8397-fc7cc3b9954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.055526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcf07c-5c4d-46fc-8397-fc7cc3b9954b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.055815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcf07c-5c4d-46fc-8397-fc7cc3b9954b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.056090 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcf07c-5c4d-46fc-8397-fc7cc3b9954b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.065663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcf07c-5c4d-46fc-8397-fc7cc3b9954b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.065928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d360635-55f2-4b83-b735-587793f65236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.066692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d360635-55f2-4b83-b735-587793f65236 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.066976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d360635-55f2-4b83-b735-587793f65236 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.067184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcf07c-5c4d-46fc-8397-fc7cc3b9954b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.067347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d360635-55f2-4b83-b735-587793f65236 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.074811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d360635-55f2-4b83-b735-587793f65236 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.076824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d360635-55f2-4b83-b735-587793f65236 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a3fcf07c-5c4d-46fc-8397-fc7cc3b9954b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:41.083995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:41.086056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 304/595] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:41.088382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcf07c-5c4d-46fc-8397-fc7cc3b9954b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5d360635-55f2-4b83-b735-587793f65236 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:41.096254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:41.098291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:41.100471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:41.100471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:41.100471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:41.100471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:41.100471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:41.100471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:41.100471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:41.100471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:41.107199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 292/596] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:41.107199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d360635-55f2-4b83-b735-587793f65236 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.172304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.195222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcf07c-5c4d-46fc-8397-fc7cc3b9954b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.214901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d360635-55f2-4b83-b735-587793f65236 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.232340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad73df-901e-4ad6-a9af-5d019df97006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.233818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad73df-901e-4ad6-a9af-5d019df97006 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.234328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad73df-901e-4ad6-a9af-5d019df97006 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.234805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad73df-901e-4ad6-a9af-5d019df97006 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.243061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad73df-901e-4ad6-a9af-5d019df97006 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.244793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad73df-901e-4ad6-a9af-5d019df97006 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.251950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51c215-5dd4-4f1e-bdf3-66582e22a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.252614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51c215-5dd4-4f1e-bdf3-66582e22a53f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.252896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51c215-5dd4-4f1e-bdf3-66582e22a53f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.253168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51c215-5dd4-4f1e-bdf3-66582e22a53f None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.253951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51c215-5dd4-4f1e-bdf3-66582e22a53f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:41.254255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51c215-5dd4-4f1e-bdf3-66582e22a53f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.258462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51c215-5dd4-4f1e-bdf3-66582e22a53f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6fad73df-901e-4ad6-a9af-5d019df97006 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:41.265499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:41.266438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:41.267577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:41.269936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 305/597] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:41.270985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad73df-901e-4ad6-a9af-5d019df97006 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.282540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 293/598] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:41.283454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51c215-5dd4-4f1e-bdf3-66582e22a53f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.324556 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.384051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad73df-901e-4ad6-a9af-5d019df97006 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.390783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51c215-5dd4-4f1e-bdf3-66582e22a53f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.409108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.420640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f810-77c8-4994-a864-89277e24ca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.421571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f810-77c8-4994-a864-89277e24ca24 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.422023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f810-77c8-4994-a864-89277e24ca24 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.422465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f810-77c8-4994-a864-89277e24ca24 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.423580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f810-77c8-4994-a864-89277e24ca24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:41.424210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f810-77c8-4994-a864-89277e24ca24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.426275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f810-77c8-4994-a864-89277e24ca24 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.427435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73b657-8b6e-4767-b0ab-f0635709bdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.428185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73b657-8b6e-4767-b0ab-f0635709bdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.428534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73b657-8b6e-4767-b0ab-f0635709bdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.428875 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73b657-8b6e-4767-b0ab-f0635709bdb7 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.429784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73b657-8b6e-4767-b0ab-f0635709bdb7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:41.430161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73b657-8b6e-4767-b0ab-f0635709bdb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.431769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73b657-8b6e-4767-b0ab-f0635709bdb7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.442241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 306/599] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:41.443326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f810-77c8-4994-a864-89277e24ca24 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.456010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 294/600] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:41.456806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73b657-8b6e-4767-b0ab-f0635709bdb7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.553539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f810-77c8-4994-a864-89277e24ca24 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.556256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.564677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73b657-8b6e-4767-b0ab-f0635709bdb7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.589864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7972c2-4ecc-474b-9d3c-2335b6d9baf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.591696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7972c2-4ecc-474b-9d3c-2335b6d9baf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.592188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7972c2-4ecc-474b-9d3c-2335b6d9baf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.592700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7972c2-4ecc-474b-9d3c-2335b6d9baf5 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/a75463d1b7714510b3898b7fe05baf50/roles/e8972a7e9ed3405c9912b4d0a12fa6f6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.600985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb05e3e-b1c5-4a85-b80f-deb4a9f649f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.601926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05e3e-b1c5-4a85-b80f-deb4a9f649f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.602206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05e3e-b1c5-4a85-b80f-deb4a9f649f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05e3e-b1c5-4a85-b80f-deb4a9f649f1 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/bbbc657ed3ae49dc9d45687c5dde2ca1/roles/e8972a7e9ed3405c9912b4d0a12fa6f6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.611495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7972c2-4ecc-474b-9d3c-2335b6d9baf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=a75463d1b7714510b3898b7fe05baf50, role_id=e8972a7e9ed3405c9912b4d0a12fa6f6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.613229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7972c2-4ecc-474b-9d3c-2335b6d9baf5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.618975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb05e3e-b1c5-4a85-b80f-deb4a9f649f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=bbbc657ed3ae49dc9d45687c5dde2ca1, role_id=e8972a7e9ed3405c9912b4d0a12fa6f6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.620456 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb05e3e-b1c5-4a85-b80f-deb4a9f649f1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.676481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 307/601] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:41 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/a75463d1b7714510b3898b7fe05baf50/roles/e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:41.677313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7972c2-4ecc-474b-9d3c-2335b6d9baf5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.709430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 295/602] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:41 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/bbbc657ed3ae49dc9d45687c5dde2ca1/roles/e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:41.711123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fc3c7-8c1c-4d45-aaf2-c5ca99dd1950 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.711598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fc3c7-8c1c-4d45-aaf2-c5ca99dd1950 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.711710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fc3c7-8c1c-4d45-aaf2-c5ca99dd1950 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.719324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 296/603] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:41.721666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5db606-9139-471e-872f-8f6f3eff6e50 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.721834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5db606-9139-471e-872f-8f6f3eff6e50 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.722041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5db606-9139-471e-872f-8f6f3eff6e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.768341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0d5db606-9139-471e-872f-8f6f3eff6e50 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:41.769580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0d5db606-9139-471e-872f-8f6f3eff6e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:41.817322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7972c2-4ecc-474b-9d3c-2335b6d9baf5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.837949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.870618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0ae7-dc8a-4abb-80d2-28b9f009b04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.893663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0ae7-dc8a-4abb-80d2-28b9f009b04c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.893663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0ae7-dc8a-4abb-80d2-28b9f009b04c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.893663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0ae7-dc8a-4abb-80d2-28b9f009b04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.893663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc0ae7-dc8a-4abb-80d2-28b9f009b04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.893663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc0ae7-dc8a-4abb-80d2-28b9f009b04c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f3dc0ae7-dc8a-4abb-80d2-28b9f009b04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:41.910755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:41.911826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:41.912749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:41.912749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:41.912749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:41.912749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:41.912994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 308/604] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:41.914329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f10d4-ef7a-4841-81c7-1f1dfbdf87f2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.914620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f10d4-ef7a-4841-81c7-1f1dfbdf87f2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.914899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f10d4-ef7a-4841-81c7-1f1dfbdf87f2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.916810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 309/605] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:41.924638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f1e9-4d19-4522-8cd5-2636641eefdc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.925158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f1e9-4d19-4522-8cd5-2636641eefdc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.925566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f1e9-4d19-4522-8cd5-2636641eefdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.929158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 297/606] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:41.930045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5db606-9139-471e-872f-8f6f3eff6e50 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.943617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.952086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e154f1e9-4d19-4522-8cd5-2636641eefdc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:41.953517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e154f1e9-4d19-4522-8cd5-2636641eefdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:42.040986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 310/607] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:42.042064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f1e9-4d19-4522-8cd5-2636641eefdc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.047679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5db606-9139-471e-872f-8f6f3eff6e50 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.088840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8a3c8-f522-4474-9c80-ba2b9b99d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.089433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8a3c8-f522-4474-9c80-ba2b9b99d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.089714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8a3c8-f522-4474-9c80-ba2b9b99d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.089993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8a3c8-f522-4474-9c80-ba2b9b99d2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.090717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8a3c8-f522-4474-9c80-ba2b9b99d2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:42.091048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8a3c8-f522-4474-9c80-ba2b9b99d2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.093072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8a3c8-f522-4474-9c80-ba2b9b99d2e0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.108326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 298/608] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:42.109302 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8a3c8-f522-4474-9c80-ba2b9b99d2e0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.150039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f1e9-4d19-4522-8cd5-2636641eefdc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.185732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffcb8d-424b-49bb-9f1d-230ade58a6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.186683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffcb8d-424b-49bb-9f1d-230ade58a6db None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.187067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffcb8d-424b-49bb-9f1d-230ade58a6db None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.187465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffcb8d-424b-49bb-9f1d-230ade58a6db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.198508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffcb8d-424b-49bb-9f1d-230ade58a6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5bffcb8d-424b-49bb-9f1d-230ade58a6db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:42.207077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:42.208104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 311/609] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:42.209575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffcb8d-424b-49bb-9f1d-230ade58a6db None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.236524 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8a3c8-f522-4474-9c80-ba2b9b99d2e0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.272658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.282854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0cd12-4d03-47d3-ae2c-3ede38e7daf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.284473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0cd12-4d03-47d3-ae2c-3ede38e7daf0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.285094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0cd12-4d03-47d3-ae2c-3ede38e7daf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.285689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0cd12-4d03-47d3-ae2c-3ede38e7daf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.299644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0cd12-4d03-47d3-ae2c-3ede38e7daf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-02f0cd12-4d03-47d3-ae2c-3ede38e7daf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:42.308882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:42.310709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:42.311569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:42.314279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 299/610] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:42.315270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0cd12-4d03-47d3-ae2c-3ede38e7daf0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.339948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffcb8d-424b-49bb-9f1d-230ade58a6db None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.352339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.384095 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96a3aa-7858-4ec0-8d32-11382cb99da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.385617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96a3aa-7858-4ec0-8d32-11382cb99da1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.386185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96a3aa-7858-4ec0-8d32-11382cb99da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.386701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96a3aa-7858-4ec0-8d32-11382cb99da1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.401426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96a3aa-7858-4ec0-8d32-11382cb99da1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.406617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96a3aa-7858-4ec0-8d32-11382cb99da1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.412075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9d96a3aa-7858-4ec0-8d32-11382cb99da1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:42.423812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:42.429933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 312/611] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:42.431155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96a3aa-7858-4ec0-8d32-11382cb99da1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.442718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0cd12-4d03-47d3-ae2c-3ede38e7daf0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.485254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0e5ce-3026-4127-9330-484f951296f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.485925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0e5ce-3026-4127-9330-484f951296f7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.486208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0e5ce-3026-4127-9330-484f951296f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.486485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0e5ce-3026-4127-9330-484f951296f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.487267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0e5ce-3026-4127-9330-484f951296f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:42.487579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0e5ce-3026-4127-9330-484f951296f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.489411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0e5ce-3026-4127-9330-484f951296f7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.492535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.500972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 300/612] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:42.501826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0e5ce-3026-4127-9330-484f951296f7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.540921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96a3aa-7858-4ec0-8d32-11382cb99da1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.578758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e65e7-90d0-4b94-83b7-1c449702200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.579917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e65e7-90d0-4b94-83b7-1c449702200f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.580413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e65e7-90d0-4b94-83b7-1c449702200f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.580898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e65e7-90d0-4b94-83b7-1c449702200f None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.581859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e65e7-90d0-4b94-83b7-1c449702200f None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:42.582466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e65e7-90d0-4b94-83b7-1c449702200f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.584197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e65e7-90d0-4b94-83b7-1c449702200f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.598046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 313/613] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:42.599225 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e65e7-90d0-4b94-83b7-1c449702200f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.622977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0e5ce-3026-4127-9330-484f951296f7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.667814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404c3cf-e392-4478-844d-d121b5214e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.668479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404c3cf-e392-4478-844d-d121b5214e92 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.668758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404c3cf-e392-4478-844d-d121b5214e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.669027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404c3cf-e392-4478-844d-d121b5214e92 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.670340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404c3cf-e392-4478-844d-d121b5214e92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:42.670647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404c3cf-e392-4478-844d-d121b5214e92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.672089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404c3cf-e392-4478-844d-d121b5214e92 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.679468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.694849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 301/614] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:42.694849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404c3cf-e392-4478-844d-d121b5214e92 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.718143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e65e7-90d0-4b94-83b7-1c449702200f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.736581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.754411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713e66b-de94-45cd-9d1f-cbe2a526b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.755225 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713e66b-de94-45cd-9d1f-cbe2a526b513 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.755508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713e66b-de94-45cd-9d1f-cbe2a526b513 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.755780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713e66b-de94-45cd-9d1f-cbe2a526b513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.766875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713e66b-de94-45cd-9d1f-cbe2a526b513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.769446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713e66b-de94-45cd-9d1f-cbe2a526b513 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a713e66b-de94-45cd-9d1f-cbe2a526b513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:42.786783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:42.787727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:42.788603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:42.788603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:42.788603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:42.788603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:42.788603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 314/615] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:42.789293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713e66b-de94-45cd-9d1f-cbe2a526b513 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.808047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404c3cf-e392-4478-844d-d121b5214e92 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.843842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012c26b-e623-41a5-9463-588f58bdec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.844962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c26b-e623-41a5-9463-588f58bdec7c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.845721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c26b-e623-41a5-9463-588f58bdec7c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.846203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012c26b-e623-41a5-9463-588f58bdec7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.857387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012c26b-e623-41a5-9463-588f58bdec7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.859054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012c26b-e623-41a5-9463-588f58bdec7c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d012c26b-e623-41a5-9463-588f58bdec7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:42.877842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:42.878824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:42.879748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:42.879748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:42.879748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:42.879748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:42.886155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 302/616] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:42.887269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012c26b-e623-41a5-9463-588f58bdec7c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.894718 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713e66b-de94-45cd-9d1f-cbe2a526b513 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.930610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f397772-8186-4a41-83c3-782ff3fb25b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.931741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397772-8186-4a41-83c3-782ff3fb25b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.931865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397772-8186-4a41-83c3-782ff3fb25b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.932078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397772-8186-4a41-83c3-782ff3fb25b7 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/4bc0ef455caa4ee5b6b86dc1904d4e24/roles/e8972a7e9ed3405c9912b4d0a12fa6f6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.944936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.950443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f397772-8186-4a41-83c3-782ff3fb25b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=4bc0ef455caa4ee5b6b86dc1904d4e24, role_id=e8972a7e9ed3405c9912b4d0a12fa6f6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.951979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f397772-8186-4a41-83c3-782ff3fb25b7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.999234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012c26b-e623-41a5-9463-588f58bdec7c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.034050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f2233-8374-4f7a-b450-15d1570bc153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.034730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f2233-8374-4f7a-b450-15d1570bc153 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.035009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f2233-8374-4f7a-b450-15d1570bc153 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.035309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f2233-8374-4f7a-b450-15d1570bc153 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.036046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f2233-8374-4f7a-b450-15d1570bc153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:43.036339 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f2233-8374-4f7a-b450-15d1570bc153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.037928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f2233-8374-4f7a-b450-15d1570bc153 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.047536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 315/617] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:42 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/4bc0ef455caa4ee5b6b86dc1904d4e24/roles/e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:43.049266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f397772-8186-4a41-83c3-782ff3fb25b7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.067496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 303/618] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:43.072216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f2233-8374-4f7a-b450-15d1570bc153 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.100421 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.251175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f2233-8374-4f7a-b450-15d1570bc153 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.271160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.297785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f397772-8186-4a41-83c3-782ff3fb25b7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.308599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002b746-feb3-4e0a-8d16-8fb9e5936470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.310170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002b746-feb3-4e0a-8d16-8fb9e5936470 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.310660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002b746-feb3-4e0a-8d16-8fb9e5936470 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.311699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002b746-feb3-4e0a-8d16-8fb9e5936470 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.324770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002b746-feb3-4e0a-8d16-8fb9e5936470 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.327758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002b746-feb3-4e0a-8d16-8fb9e5936470 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.343031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac5a5a-759f-42a8-b15b-8a175ce0ef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.343896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac5a5a-759f-42a8-b15b-8a175ce0ef26 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.344275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac5a5a-759f-42a8-b15b-8a175ce0ef26 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.344644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac5a5a-759f-42a8-b15b-8a175ce0ef26 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.345737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac5a5a-759f-42a8-b15b-8a175ce0ef26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:43.346143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac5a5a-759f-42a8-b15b-8a175ce0ef26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c002b746-feb3-4e0a-8d16-8fb9e5936470 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:43.347578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:43.348597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:43.349548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:43.350096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac5a5a-759f-42a8-b15b-8a175ce0ef26 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.352780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 304/619] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:43.364059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002b746-feb3-4e0a-8d16-8fb9e5936470 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.367278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 316/620] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:43.372857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac5a5a-759f-42a8-b15b-8a175ce0ef26 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.524815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002b746-feb3-4e0a-8d16-8fb9e5936470 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.559121 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.560062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d075a0b-145d-4812-830d-2a295ddee8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.560847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d075a0b-145d-4812-830d-2a295ddee8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.561279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d075a0b-145d-4812-830d-2a295ddee8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.561631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d075a0b-145d-4812-830d-2a295ddee8f7 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.562637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d075a0b-145d-4812-830d-2a295ddee8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:43.563043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d075a0b-145d-4812-830d-2a295ddee8f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.564794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d075a0b-145d-4812-830d-2a295ddee8f7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.587629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 305/621] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:43.589876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d075a0b-145d-4812-830d-2a295ddee8f7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.601593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac5a5a-759f-42a8-b15b-8a175ce0ef26 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.640626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fac32-9404-47ee-9145-8255cce0eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.641424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fac32-9404-47ee-9145-8255cce0eeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.641705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fac32-9404-47ee-9145-8255cce0eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.641978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fac32-9404-47ee-9145-8255cce0eeb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.650619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fac32-9404-47ee-9145-8255cce0eeb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.652618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.654135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fac32-9404-47ee-9145-8255cce0eeb8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8e3fac32-9404-47ee-9145-8255cce0eeb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:43.670007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:43.670990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:43.672138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 317/622] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:43.678310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fac32-9404-47ee-9145-8255cce0eeb8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.815138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d075a0b-145d-4812-830d-2a295ddee8f7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.855389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fac32-9404-47ee-9145-8255cce0eeb8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.876771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da3267-daee-4a38-9cdb-82c121fc87fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.877594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da3267-daee-4a38-9cdb-82c121fc87fd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.877878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da3267-daee-4a38-9cdb-82c121fc87fd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.878149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da3267-daee-4a38-9cdb-82c121fc87fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.890343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da3267-daee-4a38-9cdb-82c121fc87fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.891840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da3267-daee-4a38-9cdb-82c121fc87fd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-59da3267-daee-4a38-9cdb-82c121fc87fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:43.911356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:43.912325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:43.913453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:43.913453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:43.913453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:43.913453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:43.913453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 306/623] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:43.918237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da3267-daee-4a38-9cdb-82c121fc87fd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.942979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074da63-ed61-4a0f-ad00-dc50852c09f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.943684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074da63-ed61-4a0f-ad00-dc50852c09f8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.943965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074da63-ed61-4a0f-ad00-dc50852c09f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.944245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074da63-ed61-4a0f-ad00-dc50852c09f8 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.946777 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074da63-ed61-4a0f-ad00-dc50852c09f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:43.947108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074da63-ed61-4a0f-ad00-dc50852c09f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.951610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074da63-ed61-4a0f-ad00-dc50852c09f8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.971470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.986685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 318/624] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:43.994087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074da63-ed61-4a0f-ad00-dc50852c09f8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.080452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.114046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da3267-daee-4a38-9cdb-82c121fc87fd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.151226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc07557-7132-4c34-8942-f142d1705433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.151896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07557-7132-4c34-8942-f142d1705433 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.152176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07557-7132-4c34-8942-f142d1705433 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.152448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07557-7132-4c34-8942-f142d1705433 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.154232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc07557-7132-4c34-8942-f142d1705433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:44.154540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc07557-7132-4c34-8942-f142d1705433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.155946 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc07557-7132-4c34-8942-f142d1705433 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.169209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 307/625] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:44.175546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc07557-7132-4c34-8942-f142d1705433 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.203458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074da63-ed61-4a0f-ad00-dc50852c09f8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.241741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012336c-9fc1-4984-8fbd-d828c033f071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.242384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012336c-9fc1-4984-8fbd-d828c033f071 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.242670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012336c-9fc1-4984-8fbd-d828c033f071 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.242943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012336c-9fc1-4984-8fbd-d828c033f071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.288278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc07557-7132-4c34-8942-f142d1705433 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.313887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.317402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012336c-9fc1-4984-8fbd-d828c033f071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.318917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012336c-9fc1-4984-8fbd-d828c033f071 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.325932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba3c64-7c7e-4eaa-a7a4-3e23999e4310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.326715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3c64-7c7e-4eaa-a7a4-3e23999e4310 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.327362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3c64-7c7e-4eaa-a7a4-3e23999e4310 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.327475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3c64-7c7e-4eaa-a7a4-3e23999e4310 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.334394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba3c64-7c7e-4eaa-a7a4-3e23999e4310 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.335779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba3c64-7c7e-4eaa-a7a4-3e23999e4310 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.339357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-07ba3c64-7c7e-4eaa-a7a4-3e23999e4310 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:44.352614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:44.354697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 308/626] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c6a1-3de4-471a-9033-fb3899637df6 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.355607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c6a1-3de4-471a-9033-fb3899637df6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.357668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c6a1-3de4-471a-9033-fb3899637df6 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.357912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 309/627] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:44.363552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec817-3552-424b-9f38-a63b229a2745 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.363552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec817-3552-424b-9f38-a63b229a2745 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.363552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec817-3552-424b-9f38-a63b229a2745 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.363552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 310/628] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:44.365656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ec817-3552-424b-9f38-a63b229a2745 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.440950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 319/629] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:44.442866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36102-8367-4878-8960-25e4ba4a2ec2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.443383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36102-8367-4878-8960-25e4ba4a2ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.443836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36102-8367-4878-8960-25e4ba4a2ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.460353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-42a36102-8367-4878-8960-25e4ba4a2ec2 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:44.461824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-42a36102-8367-4878-8960-25e4ba4a2ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:44.477170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ec817-3552-424b-9f38-a63b229a2745 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.513053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17072012-7423-4be4-89b1-ebc9a601be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.513713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072012-7423-4be4-89b1-ebc9a601be8b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.513996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072012-7423-4be4-89b1-ebc9a601be8b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.514268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072012-7423-4be4-89b1-ebc9a601be8b None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.515047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17072012-7423-4be4-89b1-ebc9a601be8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:44.515396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17072012-7423-4be4-89b1-ebc9a601be8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.516813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17072012-7423-4be4-89b1-ebc9a601be8b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.529157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 311/630] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:44.530391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b9521-cfb3-46da-baad-ac15523a9657 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.530677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b9521-cfb3-46da-baad-ac15523a9657 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.530951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b9521-cfb3-46da-baad-ac15523a9657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.543588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 320/631] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:44.545342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36102-8367-4878-8960-25e4ba4a2ec2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.547492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8b6b9521-cfb3-46da-baad-ac15523a9657 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:44.548672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8b6b9521-cfb3-46da-baad-ac15523a9657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:44.583507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.608843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.620346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 312/632] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:44.621330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b9521-cfb3-46da-baad-ac15523a9657 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.676624 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36102-8367-4878-8960-25e4ba4a2ec2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.712877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9105f1-8a3e-4de7-ba6a-edee3526f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.713753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9105f1-8a3e-4de7-ba6a-edee3526f32a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.714104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9105f1-8a3e-4de7-ba6a-edee3526f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.714452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9105f1-8a3e-4de7-ba6a-edee3526f32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.722066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b9521-cfb3-46da-baad-ac15523a9657 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.725606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9105f1-8a3e-4de7-ba6a-edee3526f32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.727044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9105f1-8a3e-4de7-ba6a-edee3526f32a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3c9105f1-8a3e-4de7-ba6a-edee3526f32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:44.744745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:44.745645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:44.746546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:44.746546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:44.746546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:44.746546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:44.750462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 321/633] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:44.751314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9105f1-8a3e-4de7-ba6a-edee3526f32a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.758897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76b1d6-6a06-41ab-a4e9-9f043b662792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.760122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b1d6-6a06-41ab-a4e9-9f043b662792 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.760605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b1d6-6a06-41ab-a4e9-9f043b662792 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.761088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b1d6-6a06-41ab-a4e9-9f043b662792 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/ffbe700a0ebc48b5953a600400ecfed5/roles/e8972a7e9ed3405c9912b4d0a12fa6f6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.775871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76b1d6-6a06-41ab-a4e9-9f043b662792 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=ffbe700a0ebc48b5953a600400ecfed5, role_id=e8972a7e9ed3405c9912b4d0a12fa6f6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.777554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76b1d6-6a06-41ab-a4e9-9f043b662792 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.832139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.851688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9105f1-8a3e-4de7-ba6a-edee3526f32a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.854162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 313/634] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:44 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/ffbe700a0ebc48b5953a600400ecfed5/roles/e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:44.859850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76b1d6-6a06-41ab-a4e9-9f043b662792 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.894052 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766910bf-4453-44ba-ba72-ef53ace88eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.895352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766910bf-4453-44ba-ba72-ef53ace88eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.895875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766910bf-4453-44ba-ba72-ef53ace88eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.896332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766910bf-4453-44ba-ba72-ef53ace88eb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.909787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766910bf-4453-44ba-ba72-ef53ace88eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-766910bf-4453-44ba-ba72-ef53ace88eb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:44.919108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:44.920136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:44.921031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:44.921700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.923809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 322/635] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:44.925059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766910bf-4453-44ba-ba72-ef53ace88eb6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.008901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76b1d6-6a06-41ab-a4e9-9f043b662792 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.053486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766910bf-4453-44ba-ba72-ef53ace88eb6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.059986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877efa-9784-4ee0-8b81-5c7332d04391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.060356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877efa-9784-4ee0-8b81-5c7332d04391 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.060730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877efa-9784-4ee0-8b81-5c7332d04391 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.061096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877efa-9784-4ee0-8b81-5c7332d04391 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.073880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6877efa-9784-4ee0-8b81-5c7332d04391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-c6877efa-9784-4ee0-8b81-5c7332d04391 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:45.084155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:45.085134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:45.086032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 314/636] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:45.086754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877efa-9784-4ee0-8b81-5c7332d04391 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.101037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c233c-416e-4369-aa66-a0d6c0e82a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.101764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c233c-416e-4369-aa66-a0d6c0e82a48 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.102079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c233c-416e-4369-aa66-a0d6c0e82a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.102265 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c233c-416e-4369-aa66-a0d6c0e82a48 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.102958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c233c-416e-4369-aa66-a0d6c0e82a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:45.103304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c233c-416e-4369-aa66-a0d6c0e82a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.104698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c233c-416e-4369-aa66-a0d6c0e82a48 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.114421 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.117834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 323/637] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:45.123429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c233c-416e-4369-aa66-a0d6c0e82a48 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.201255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.204389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877efa-9784-4ee0-8b81-5c7332d04391 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.241600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd23eb-fa31-497d-9070-9a610a3590ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.242615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd23eb-fa31-497d-9070-9a610a3590ab None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.242893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd23eb-fa31-497d-9070-9a610a3590ab None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.243226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd23eb-fa31-497d-9070-9a610a3590ab None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.244244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd23eb-fa31-497d-9070-9a610a3590ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:45.244859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd23eb-fa31-497d-9070-9a610a3590ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.245308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c233c-416e-4369-aa66-a0d6c0e82a48 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.246296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd23eb-fa31-497d-9070-9a610a3590ab None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.259565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 315/638] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:45.260603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd23eb-fa31-497d-9070-9a610a3590ab None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.293966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a6305-e69d-4cb3-b6bc-812bb0e4d2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.295114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6305-e69d-4cb3-b6bc-812bb0e4d2fb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.295605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6305-e69d-4cb3-b6bc-812bb0e4d2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.296033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a6305-e69d-4cb3-b6bc-812bb0e4d2fb None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.296911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a6305-e69d-4cb3-b6bc-812bb0e4d2fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:45.297356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a6305-e69d-4cb3-b6bc-812bb0e4d2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.299032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a6305-e69d-4cb3-b6bc-812bb0e4d2fb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.312842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 324/639] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:45.314031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a6305-e69d-4cb3-b6bc-812bb0e4d2fb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.369822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd23eb-fa31-497d-9070-9a610a3590ab None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.379821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.407796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf510b2e-2d07-4fa1-9b3d-2d5391f42821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.408596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf510b2e-2d07-4fa1-9b3d-2d5391f42821 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.408879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf510b2e-2d07-4fa1-9b3d-2d5391f42821 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.411196 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf510b2e-2d07-4fa1-9b3d-2d5391f42821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.418704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf510b2e-2d07-4fa1-9b3d-2d5391f42821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.420698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf510b2e-2d07-4fa1-9b3d-2d5391f42821 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.423801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a6305-e69d-4cb3-b6bc-812bb0e4d2fb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-bf510b2e-2d07-4fa1-9b3d-2d5391f42821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:45.440667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:45.441620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:45.442495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:45.442495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:45.442495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:45.442495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:45.442495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:45.442495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:45.442495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:45.442495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:45.442495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 316/640] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:45.443506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf510b2e-2d07-4fa1-9b3d-2d5391f42821 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.466299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7539e8f-a267-406e-a34f-7cfb6cbd30d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.467812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7539e8f-a267-406e-a34f-7cfb6cbd30d9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.468292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7539e8f-a267-406e-a34f-7cfb6cbd30d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.468791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7539e8f-a267-406e-a34f-7cfb6cbd30d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.474146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.481422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7539e8f-a267-406e-a34f-7cfb6cbd30d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.485857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7539e8f-a267-406e-a34f-7cfb6cbd30d9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a7539e8f-a267-406e-a34f-7cfb6cbd30d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:45.501343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:45.502322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:45.503248 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:45.503248 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:45.503248 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:45.503248 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:45.506354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 325/641] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:45.507374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7539e8f-a267-406e-a34f-7cfb6cbd30d9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.564254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf510b2e-2d07-4fa1-9b3d-2d5391f42821 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.599711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6620-c5af-482d-9093-223c67126298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.600869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6620-c5af-482d-9093-223c67126298 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.601452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6620-c5af-482d-9093-223c67126298 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.602039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6620-c5af-482d-9093-223c67126298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.612890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d6620-c5af-482d-9093-223c67126298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.614671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d6620-c5af-482d-9093-223c67126298 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.616041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7539e8f-a267-406e-a34f-7cfb6cbd30d9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.630064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1f8d6620-c5af-482d-9093-223c67126298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:45.633830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:45.634715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:45.635775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:45.635775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:45.635775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:45.635775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:45.639314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 317/642] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:45.644809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6620-c5af-482d-9093-223c67126298 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.656249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd65298-730a-4bce-990c-771f0265e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.657046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd65298-730a-4bce-990c-771f0265e802 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.657388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd65298-730a-4bce-990c-771f0265e802 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.657749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd65298-730a-4bce-990c-771f0265e802 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.658597 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd65298-730a-4bce-990c-771f0265e802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:45.658977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd65298-730a-4bce-990c-771f0265e802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.660481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd65298-730a-4bce-990c-771f0265e802 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.678796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 326/643] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:45.680195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484392fc-8955-4c3f-9516-35034171d251 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.680479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484392fc-8955-4c3f-9516-35034171d251 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.680752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484392fc-8955-4c3f-9516-35034171d251 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.683143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 327/644] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:45.683143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484392fc-8955-4c3f-9516-35034171d251 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.722479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.750259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6620-c5af-482d-9093-223c67126298 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.786342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c36e30-a428-4e94-92b3-bb544352856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.787175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c36e30-a428-4e94-92b3-bb544352856f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.787572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c36e30-a428-4e94-92b3-bb544352856f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.787945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c36e30-a428-4e94-92b3-bb544352856f None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.788731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c36e30-a428-4e94-92b3-bb544352856f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:45.789118 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c36e30-a428-4e94-92b3-bb544352856f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.790508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c36e30-a428-4e94-92b3-bb544352856f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.793043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484392fc-8955-4c3f-9516-35034171d251 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.806693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 318/645] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:45.806693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c36e30-a428-4e94-92b3-bb544352856f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.835368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3294004-a7a1-4064-bda2-8dfc025ad914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.854872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3294004-a7a1-4064-bda2-8dfc025ad914 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.854872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3294004-a7a1-4064-bda2-8dfc025ad914 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.854872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3294004-a7a1-4064-bda2-8dfc025ad914 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.854872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3294004-a7a1-4064-bda2-8dfc025ad914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:45.854872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3294004-a7a1-4064-bda2-8dfc025ad914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.854872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3294004-a7a1-4064-bda2-8dfc025ad914 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.855398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 328/646] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:45.855398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26173dd7-33a6-45f8-89b7-c84427b5bb75 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.855398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26173dd7-33a6-45f8-89b7-c84427b5bb75 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.855398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26173dd7-33a6-45f8-89b7-c84427b5bb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.869721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-26173dd7-33a6-45f8-89b7-c84427b5bb75 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:45.870986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-26173dd7-33a6-45f8-89b7-c84427b5bb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:45.898927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.919830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c36e30-a428-4e94-92b3-bb544352856f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.940786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 329/647] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:45.941426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26173dd7-33a6-45f8-89b7-c84427b5bb75 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.967415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f87e7-b469-44f8-9aad-f71b7740f044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.968074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f87e7-b469-44f8-9aad-f71b7740f044 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.968345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f87e7-b469-44f8-9aad-f71b7740f044 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.968617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f87e7-b469-44f8-9aad-f71b7740f044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.969439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f87e7-b469-44f8-9aad-f71b7740f044 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=0b0591179ec144f5a90c9a24205b6b47) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:45.969745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f87e7-b469-44f8-9aad-f71b7740f044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.971438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f87e7-b469-44f8-9aad-f71b7740f044 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.973399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.987117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 319/648] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/role_assignments?user.id=0b0591179ec144f5a90c9a24205b6b47&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:45.987117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f87e7-b469-44f8-9aad-f71b7740f044 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.067634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26173dd7-33a6-45f8-89b7-c84427b5bb75 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.112192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9786c-b593-4317-b279-1128c1b7a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.113007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9786c-b593-4317-b279-1128c1b7a493 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.113287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9786c-b593-4317-b279-1128c1b7a493 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.113558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9786c-b593-4317-b279-1128c1b7a493 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.121926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f87e7-b469-44f8-9aad-f71b7740f044 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.122122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9786c-b593-4317-b279-1128c1b7a493 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.123796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9786c-b593-4317-b279-1128c1b7a493 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b7b9786c-b593-4317-b279-1128c1b7a493 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:46.144957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:46.145943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:46.146914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:46.151570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 330/649] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:46.152436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9786c-b593-4317-b279-1128c1b7a493 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.168481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83115c8-4743-4238-87bd-e5a7184d17ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.169859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83115c8-4743-4238-87bd-e5a7184d17ad None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.170401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83115c8-4743-4238-87bd-e5a7184d17ad None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.170682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83115c8-4743-4238-87bd-e5a7184d17ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.185932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83115c8-4743-4238-87bd-e5a7184d17ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.186753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83115c8-4743-4238-87bd-e5a7184d17ad None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.187960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a83115c8-4743-4238-87bd-e5a7184d17ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:46.202106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:46.207739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 320/650] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:46.208720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83115c8-4743-4238-87bd-e5a7184d17ad None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.285227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.292766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9786c-b593-4317-b279-1128c1b7a493 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.337193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71762cf-732f-4fde-9e59-4658f463c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.338142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71762cf-732f-4fde-9e59-4658f463c35a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.338521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71762cf-732f-4fde-9e59-4658f463c35a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.338894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71762cf-732f-4fde-9e59-4658f463c35a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.340485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83115c8-4743-4238-87bd-e5a7184d17ad None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.353776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71762cf-732f-4fde-9e59-4658f463c35a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-e71762cf-732f-4fde-9e59-4658f463c35a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:46.364246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:46.365209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:46.366063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 331/651] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:46.367493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71762cf-732f-4fde-9e59-4658f463c35a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.381904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a837d0-2bb5-4062-8ab0-9ceb4d51cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.383207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a837d0-2bb5-4062-8ab0-9ceb4d51cb69 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.383688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a837d0-2bb5-4062-8ab0-9ceb4d51cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.384417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a837d0-2bb5-4062-8ab0-9ceb4d51cb69 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.385709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a837d0-2bb5-4062-8ab0-9ceb4d51cb69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:46.386197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a837d0-2bb5-4062-8ab0-9ceb4d51cb69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.388877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a837d0-2bb5-4062-8ab0-9ceb4d51cb69 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.411802 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 321/652] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:46.412923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a837d0-2bb5-4062-8ab0-9ceb4d51cb69 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.467917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.485382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71762cf-732f-4fde-9e59-4658f463c35a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.521221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ae530-6a37-4370-a1b3-20b3d740bb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.522235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ae530-6a37-4370-a1b3-20b3d740bb05 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.522741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ae530-6a37-4370-a1b3-20b3d740bb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.523249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ae530-6a37-4370-a1b3-20b3d740bb05 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.524277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ae530-6a37-4370-a1b3-20b3d740bb05 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:46.524809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ae530-6a37-4370-a1b3-20b3d740bb05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.526477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ae530-6a37-4370-a1b3-20b3d740bb05 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.534910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a837d0-2bb5-4062-8ab0-9ceb4d51cb69 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.545643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 332/653] 10.222.0.13 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:46.546719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ae530-6a37-4370-a1b3-20b3d740bb05 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.582037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eecb2-49b9-4cd9-9c61-1ef4c2bc4a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.583004 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eecb2-49b9-4cd9-9c61-1ef4c2bc4a96 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.583307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eecb2-49b9-4cd9-9c61-1ef4c2bc4a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.583585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eecb2-49b9-4cd9-9c61-1ef4c2bc4a96 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.584610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eecb2-49b9-4cd9-9c61-1ef4c2bc4a96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:46.584920 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eecb2-49b9-4cd9-9c61-1ef4c2bc4a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.586283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eecb2-49b9-4cd9-9c61-1ef4c2bc4a96 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.597683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 322/654] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:46.598726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eecb2-49b9-4cd9-9c61-1ef4c2bc4a96 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.603443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.666515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ae530-6a37-4370-a1b3-20b3d740bb05 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.703969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4de546-b68b-4fad-ab2b-d29ca590437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.704880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4de546-b68b-4fad-ab2b-d29ca590437c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.705563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4de546-b68b-4fad-ab2b-d29ca590437c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.705847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4de546-b68b-4fad-ab2b-d29ca590437c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.711382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eecb2-49b9-4cd9-9c61-1ef4c2bc4a96 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.723471 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.754755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ac142-f843-4978-bb9c-9f11be106860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.755544 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ac142-f843-4978-bb9c-9f11be106860 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.755891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ac142-f843-4978-bb9c-9f11be106860 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.756230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ac142-f843-4978-bb9c-9f11be106860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.786926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4de546-b68b-4fad-ab2b-d29ca590437c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.788790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4de546-b68b-4fad-ab2b-d29ca590437c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.817979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.840538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ac142-f843-4978-bb9c-9f11be106860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.842301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ac142-f843-4978-bb9c-9f11be106860 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.930508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 333/655] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:46.931451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4de546-b68b-4fad-ab2b-d29ca590437c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.959612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 323/656] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:46.960839 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ac142-f843-4978-bb9c-9f11be106860 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.986847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.051708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4de546-b68b-4fad-ab2b-d29ca590437c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.054688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.079657 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ac142-f843-4978-bb9c-9f11be106860 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.100667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ef59-07f2-4c8c-bc73-76f9a9d7f0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.101472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ef59-07f2-4c8c-bc73-76f9a9d7f0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.101750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ef59-07f2-4c8c-bc73-76f9a9d7f0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.102026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ef59-07f2-4c8c-bc73-76f9a9d7f0a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.116757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341ef59-07f2-4c8c-bc73-76f9a9d7f0a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.117962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b1af7-94b5-42cf-8c67-f7473dddd70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.118297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341ef59-07f2-4c8c-bc73-76f9a9d7f0a0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.119318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b1af7-94b5-42cf-8c67-f7473dddd70d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.119801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b1af7-94b5-42cf-8c67-f7473dddd70d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.120270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b1af7-94b5-42cf-8c67-f7473dddd70d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.131514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b1af7-94b5-42cf-8c67-f7473dddd70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.133230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b1af7-94b5-42cf-8c67-f7473dddd70d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1341ef59-07f2-4c8c-bc73-76f9a9d7f0a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:47.140724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:47.141645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:47.142543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:47.142543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:47.142543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:47.142543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:47.142543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 334/657] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:47.143301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ef59-07f2-4c8c-bc73-76f9a9d7f0a0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-7a9b1af7-94b5-42cf-8c67-f7473dddd70d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:47.155690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:47.156604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:47.157559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:47.157559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:47.157559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:47.157559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:47.159781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 324/658] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:47.160893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b1af7-94b5-42cf-8c67-f7473dddd70d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.271447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.274229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b1af7-94b5-42cf-8c67-f7473dddd70d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.279056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ef59-07f2-4c8c-bc73-76f9a9d7f0a0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.306617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.313040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff95c2-637a-43ce-ac89-0ba5548f3365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.323503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff95c2-637a-43ce-ac89-0ba5548f3365 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.323503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff95c2-637a-43ce-ac89-0ba5548f3365 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.323503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff95c2-637a-43ce-ac89-0ba5548f3365 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.323503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff95c2-637a-43ce-ac89-0ba5548f3365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:47.323503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff95c2-637a-43ce-ac89-0ba5548f3365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.323503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff95c2-637a-43ce-ac89-0ba5548f3365 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.323934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667346-4693-4c28-b3ec-8246d585eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.323934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667346-4693-4c28-b3ec-8246d585eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.323934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667346-4693-4c28-b3ec-8246d585eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.323934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667346-4693-4c28-b3ec-8246d585eeb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.328114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 325/659] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:47.328770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff95c2-637a-43ce-ac89-0ba5548f3365 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.335579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667346-4693-4c28-b3ec-8246d585eeb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.337119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667346-4693-4c28-b3ec-8246d585eeb6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bc667346-4693-4c28-b3ec-8246d585eeb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:47.361515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:47.362432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:47.364024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:47.364024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:47.364024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:47.364024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:47.364024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 335/660] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:47.371167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7fb7b-f534-4a4f-baa3-975c89d9c3ba None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.371167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7fb7b-f534-4a4f-baa3-975c89d9c3ba None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.371167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7fb7b-f534-4a4f-baa3-975c89d9c3ba None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.371167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 336/661] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:47.371572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7fb7b-f534-4a4f-baa3-975c89d9c3ba None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.435643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff95c2-637a-43ce-ac89-0ba5548f3365 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.471468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97295c7c-0c34-43dd-a778-6dab5746bcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.472497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97295c7c-0c34-43dd-a778-6dab5746bcfa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.472783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97295c7c-0c34-43dd-a778-6dab5746bcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.473103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97295c7c-0c34-43dd-a778-6dab5746bcfa None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.473822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97295c7c-0c34-43dd-a778-6dab5746bcfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:47.474128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97295c7c-0c34-43dd-a778-6dab5746bcfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.475771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97295c7c-0c34-43dd-a778-6dab5746bcfa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.478831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7fb7b-f534-4a4f-baa3-975c89d9c3ba None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.493375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 326/662] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:47.493375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97295c7c-0c34-43dd-a778-6dab5746bcfa None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.517674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f028d-6f5a-47a2-9691-46771599d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.518505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f028d-6f5a-47a2-9691-46771599d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.518841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f028d-6f5a-47a2-9691-46771599d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.519222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f028d-6f5a-47a2-9691-46771599d8f0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.526269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f028d-6f5a-47a2-9691-46771599d8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.527721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f028d-6f5a-47a2-9691-46771599d8f0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-202f028d-6f5a-47a2-9691-46771599d8f0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:47.542269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:47.543412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:47.544991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 337/663] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:47.545586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fae42-e049-4c8c-bfb2-f90b83e6b678 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.545586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fae42-e049-4c8c-bfb2-f90b83e6b678 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.545770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fae42-e049-4c8c-bfb2-f90b83e6b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.553723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.556247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.562377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-881fae42-e049-4c8c-bfb2-f90b83e6b678 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:47.563747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-881fae42-e049-4c8c-bfb2-f90b83e6b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:47.609723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97295c7c-0c34-43dd-a778-6dab5746bcfa None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.634096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 338/664] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:47.634931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fae42-e049-4c8c-bfb2-f90b83e6b678 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.648052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ff7d9-be5f-4961-a636-d29219d45057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.648908 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ff7d9-be5f-4961-a636-d29219d45057 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.649342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ff7d9-be5f-4961-a636-d29219d45057 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.649787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ff7d9-be5f-4961-a636-d29219d45057 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.650711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ff7d9-be5f-4961-a636-d29219d45057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:47.651575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ff7d9-be5f-4961-a636-d29219d45057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.654218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ff7d9-be5f-4961-a636-d29219d45057 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.666780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 327/665] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:47.668255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ff7d9-be5f-4961-a636-d29219d45057 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.756891 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fae42-e049-4c8c-bfb2-f90b83e6b678 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.775164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ff7d9-be5f-4961-a636-d29219d45057 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.786725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.795386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddadbad-adf9-4c1c-8d0f-c5336f520079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.798040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddadbad-adf9-4c1c-8d0f-c5336f520079 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.798040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddadbad-adf9-4c1c-8d0f-c5336f520079 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.798040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddadbad-adf9-4c1c-8d0f-c5336f520079 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.799721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.804697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddadbad-adf9-4c1c-8d0f-c5336f520079 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.806142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddadbad-adf9-4c1c-8d0f-c5336f520079 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.812085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744000-06bc-4981-b17c-5048f0547ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.812900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744000-06bc-4981-b17c-5048f0547ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.813184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744000-06bc-4981-b17c-5048f0547ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.815262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744000-06bc-4981-b17c-5048f0547ab6 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.815262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744000-06bc-4981-b17c-5048f0547ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:47.815262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744000-06bc-4981-b17c-5048f0547ab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.816037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744000-06bc-4981-b17c-5048f0547ab6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-0ddadbad-adf9-4c1c-8d0f-c5336f520079 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:47.820722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:47.821843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:47.822931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:47.822931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:47.822931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:47.822931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:47.822931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:47.822931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:47.822931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:47.822931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:47.823774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 339/666] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:47.824780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddadbad-adf9-4c1c-8d0f-c5336f520079 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.844209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 328/667] 10.222.0.13 () {56 vars in 1139 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:47.845411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744000-06bc-4981-b17c-5048f0547ab6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.937272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddadbad-adf9-4c1c-8d0f-c5336f520079 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.952970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744000-06bc-4981-b17c-5048f0547ab6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.973506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2dc9e-b790-4cef-ba1e-5d99442f89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.974340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2dc9e-b790-4cef-ba1e-5d99442f89da None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.974622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2dc9e-b790-4cef-ba1e-5d99442f89da None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.974904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2dc9e-b790-4cef-ba1e-5d99442f89da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.985900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2dc9e-b790-4cef-ba1e-5d99442f89da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:47.989060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a861951-b488-4817-8d80-2a1e68297cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.989974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a861951-b488-4817-8d80-2a1e68297cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.990354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a861951-b488-4817-8d80-2a1e68297cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.990725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a861951-b488-4817-8d80-2a1e68297cd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b7e2dc9e-b790-4cef-ba1e-5d99442f89da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:47.993522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:47.994637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:47.995683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:47.999642 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 340/668] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:48.000290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2dc9e-b790-4cef-ba1e-5d99442f89da None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.000820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a861951-b488-4817-8d80-2a1e68297cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.002353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a861951-b488-4817-8d80-2a1e68297cd8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2a861951-b488-4817-8d80-2a1e68297cd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:48.017054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:48.018169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 329/669] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:48.024354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a861951-b488-4817-8d80-2a1e68297cd8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.053501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.073013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.118781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2dc9e-b790-4cef-ba1e-5d99442f89da None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.136698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a861951-b488-4817-8d80-2a1e68297cd8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.156038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3868a-5e7d-4fc5-8c19-d62f6b40afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.156831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3868a-5e7d-4fc5-8c19-d62f6b40afa1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.157220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3868a-5e7d-4fc5-8c19-d62f6b40afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.157603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3868a-5e7d-4fc5-8c19-d62f6b40afa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.158489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3868a-5e7d-4fc5-8c19-d62f6b40afa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:48.158906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3868a-5e7d-4fc5-8c19-d62f6b40afa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.160459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3868a-5e7d-4fc5-8c19-d62f6b40afa1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.177172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 341/670] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:48.177325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123466c-44fb-4fc5-b837-ac80b5308951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.177325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123466c-44fb-4fc5-b837-ac80b5308951 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.177493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3868a-5e7d-4fc5-8c19-d62f6b40afa1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.177605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123466c-44fb-4fc5-b837-ac80b5308951 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.177605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123466c-44fb-4fc5-b837-ac80b5308951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.256716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123466c-44fb-4fc5-b837-ac80b5308951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.258168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123466c-44fb-4fc5-b837-ac80b5308951 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.287539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.292275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3868a-5e7d-4fc5-8c19-d62f6b40afa1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.314462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.332043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d6490-0160-4616-837f-d056e01fcfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.332654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6490-0160-4616-837f-d056e01fcfcc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.332934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6490-0160-4616-837f-d056e01fcfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.333209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6490-0160-4616-837f-d056e01fcfcc None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.333946 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6490-0160-4616-837f-d056e01fcfcc None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:48.334247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6490-0160-4616-837f-d056e01fcfcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.335636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6490-0160-4616-837f-d056e01fcfcc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.344227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 342/671] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:48.345190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d6490-0160-4616-837f-d056e01fcfcc None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.373362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 330/672] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:48.374553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123466c-44fb-4fc5-b837-ac80b5308951 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.452710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d6490-0160-4616-837f-d056e01fcfcc None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.474493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123466c-44fb-4fc5-b837-ac80b5308951 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.486251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ea74f-1bbe-479b-bf98-fc4df80bbc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.486916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea74f-1bbe-479b-bf98-fc4df80bbc21 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.487226 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea74f-1bbe-479b-bf98-fc4df80bbc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.487502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ea74f-1bbe-479b-bf98-fc4df80bbc21 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.488286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ea74f-1bbe-479b-bf98-fc4df80bbc21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:48.488601 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ea74f-1bbe-479b-bf98-fc4df80bbc21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.490014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ea74f-1bbe-479b-bf98-fc4df80bbc21 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.501864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 343/673] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:48.501994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.502631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ea74f-1bbe-479b-bf98-fc4df80bbc21 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.511278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375bb04-e017-4723-a9e7-c6edafa1a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.513156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375bb04-e017-4723-a9e7-c6edafa1a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.513156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375bb04-e017-4723-a9e7-c6edafa1a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.513156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375bb04-e017-4723-a9e7-c6edafa1a2b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.513443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375bb04-e017-4723-a9e7-c6edafa1a2b1 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=bbbc657ed3ae49dc9d45687c5dde2ca1) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:48.514006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375bb04-e017-4723-a9e7-c6edafa1a2b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.515187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375bb04-e017-4723-a9e7-c6edafa1a2b1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.520884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 331/674] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/role_assignments?user.id=bbbc657ed3ae49dc9d45687c5dde2ca1&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:48.521753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375bb04-e017-4723-a9e7-c6edafa1a2b1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.550912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.618660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ea74f-1bbe-479b-bf98-fc4df80bbc21 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.636885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375bb04-e017-4723-a9e7-c6edafa1a2b1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.656898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30418aa4-beb2-4f6b-aa9e-f7989726deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.657707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30418aa4-beb2-4f6b-aa9e-f7989726deb1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.657983 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30418aa4-beb2-4f6b-aa9e-f7989726deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.658252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30418aa4-beb2-4f6b-aa9e-f7989726deb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.669387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30418aa4-beb2-4f6b-aa9e-f7989726deb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.670867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30418aa4-beb2-4f6b-aa9e-f7989726deb1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.675311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75bb68-7869-4831-b063-847e84c90dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.676120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75bb68-7869-4831-b063-847e84c90dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.676403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75bb68-7869-4831-b063-847e84c90dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.676678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75bb68-7869-4831-b063-847e84c90dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.688422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75bb68-7869-4831-b063-847e84c90dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-30418aa4-beb2-4f6b-aa9e-f7989726deb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:48.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:48.690553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:48.691886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:48.691886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:48.691886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:48.691886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:48.692372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75bb68-7869-4831-b063-847e84c90dc8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.692448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 344/675] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:48.692448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b82308-8d6c-4abf-a0a3-5dce1e082f3c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.692571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b82308-8d6c-4abf-a0a3-5dce1e082f3c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.692984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b82308-8d6c-4abf-a0a3-5dce1e082f3c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.698691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 345/676] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:48.698691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b82308-8d6c-4abf-a0a3-5dce1e082f3c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0c75bb68-7869-4831-b063-847e84c90dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:48.717588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:48.718542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:48.719478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:48.719478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:48.719478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:48.719478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:48.719478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 332/677] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:48.720041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75bb68-7869-4831-b063-847e84c90dc8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.774938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.808074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.821891 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b82308-8d6c-4abf-a0a3-5dce1e082f3c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.833780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75bb68-7869-4831-b063-847e84c90dc8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.861882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a557a-4a77-460e-97a1-d90bfbcc258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.862638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a557a-4a77-460e-97a1-d90bfbcc258d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.862993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a557a-4a77-460e-97a1-d90bfbcc258d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.863270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a557a-4a77-460e-97a1-d90bfbcc258d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.864109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a557a-4a77-460e-97a1-d90bfbcc258d None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=a75463d1b7714510b3898b7fe05baf50) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:48.864493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a557a-4a77-460e-97a1-d90bfbcc258d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.865953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a557a-4a77-460e-97a1-d90bfbcc258d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.869682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe536f-99bd-429b-bfe1-95884b4feb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.870288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe536f-99bd-429b-bfe1-95884b4feb80 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.870573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe536f-99bd-429b-bfe1-95884b4feb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.870850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe536f-99bd-429b-bfe1-95884b4feb80 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.871628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe536f-99bd-429b-bfe1-95884b4feb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:48.871939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe536f-99bd-429b-bfe1-95884b4feb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.872659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 346/678] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/role_assignments?user.id=a75463d1b7714510b3898b7fe05baf50&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:48.873668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65666116-a872-4874-b737-e043f69784d1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.874112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65666116-a872-4874-b737-e043f69784d1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.874396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65666116-a872-4874-b737-e043f69784d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.880235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe536f-99bd-429b-bfe1-95884b4feb80 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.901032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-65666116-a872-4874-b737-e043f69784d1 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:48.901599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-65666116-a872-4874-b737-e043f69784d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:48.901842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 333/679] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:48.903627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe536f-99bd-429b-bfe1-95884b4feb80 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.996044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 347/680] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:48.997257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65666116-a872-4874-b737-e043f69784d1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.055333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe536f-99bd-429b-bfe1-95884b4feb80 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.059831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.105151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cd207-3fc8-482f-b3f6-a55afc4e7714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.105151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cd207-3fc8-482f-b3f6-a55afc4e7714 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.105421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cd207-3fc8-482f-b3f6-a55afc4e7714 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.105669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cd207-3fc8-482f-b3f6-a55afc4e7714 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.106373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cd207-3fc8-482f-b3f6-a55afc4e7714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:49.106676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cd207-3fc8-482f-b3f6-a55afc4e7714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.108152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cd207-3fc8-482f-b3f6-a55afc4e7714 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.113990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.128964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 334/681] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:49.128964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cd207-3fc8-482f-b3f6-a55afc4e7714 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.133286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65666116-a872-4874-b737-e043f69784d1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.179269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65779c93-964e-4231-9553-7957d27dbb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.180234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65779c93-964e-4231-9553-7957d27dbb1f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.180616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65779c93-964e-4231-9553-7957d27dbb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.180990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65779c93-964e-4231-9553-7957d27dbb1f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.189919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65779c93-964e-4231-9553-7957d27dbb1f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.191612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65779c93-964e-4231-9553-7957d27dbb1f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-65779c93-964e-4231-9553-7957d27dbb1f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:49.208405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:49.209608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:49.210778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:49.212684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 348/682] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:49.213555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65779c93-964e-4231-9553-7957d27dbb1f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.254318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cd207-3fc8-482f-b3f6-a55afc4e7714 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.302983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54705e-72b8-4f8c-8121-505c92694c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.303963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54705e-72b8-4f8c-8121-505c92694c3f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.304350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54705e-72b8-4f8c-8121-505c92694c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.304797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54705e-72b8-4f8c-8121-505c92694c3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.318636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54705e-72b8-4f8c-8121-505c92694c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-cf54705e-72b8-4f8c-8121-505c92694c3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:49.329080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:49.330179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:49.331023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:49.335704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 335/683] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:49.336640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54705e-72b8-4f8c-8121-505c92694c3f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.342400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65779c93-964e-4231-9553-7957d27dbb1f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.369918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.380765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c1375-0dff-4245-af7f-293d2ff2641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.381396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c1375-0dff-4245-af7f-293d2ff2641c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.381916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c1375-0dff-4245-af7f-293d2ff2641c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.382390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c1375-0dff-4245-af7f-293d2ff2641c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.390339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c1375-0dff-4245-af7f-293d2ff2641c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.392112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c1375-0dff-4245-af7f-293d2ff2641c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8b0c1375-0dff-4245-af7f-293d2ff2641c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:49.408008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:49.408932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:49.409809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:49.409809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:49.409809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:49.409809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:49.409809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:49.409809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:49.409809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:49.409809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:49.413169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 349/684] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:49.414331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c1375-0dff-4245-af7f-293d2ff2641c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.420133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.468653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54705e-72b8-4f8c-8121-505c92694c3f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.512111 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245f36b-aba2-4f0d-a053-1c15c30f0974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.512793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245f36b-aba2-4f0d-a053-1c15c30f0974 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.513075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245f36b-aba2-4f0d-a053-1c15c30f0974 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.513349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245f36b-aba2-4f0d-a053-1c15c30f0974 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.514191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245f36b-aba2-4f0d-a053-1c15c30f0974 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:49.514501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245f36b-aba2-4f0d-a053-1c15c30f0974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.516395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245f36b-aba2-4f0d-a053-1c15c30f0974 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.533012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c1375-0dff-4245-af7f-293d2ff2641c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.538336 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 336/685] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:49.539487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245f36b-aba2-4f0d-a053-1c15c30f0974 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.583830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130b9a-24ac-46d0-8766-30a69991eed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.584516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130b9a-24ac-46d0-8766-30a69991eed5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.584801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130b9a-24ac-46d0-8766-30a69991eed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.585081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130b9a-24ac-46d0-8766-30a69991eed5 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.585835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f130b9a-24ac-46d0-8766-30a69991eed5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:49.586144 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f130b9a-24ac-46d0-8766-30a69991eed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.587989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f130b9a-24ac-46d0-8766-30a69991eed5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.603251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 350/686] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:49.604668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130b9a-24ac-46d0-8766-30a69991eed5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.646776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.670711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245f36b-aba2-4f0d-a053-1c15c30f0974 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.678063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.715294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232591f-4421-4a69-aa14-354d6bd3e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.715994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232591f-4421-4a69-aa14-354d6bd3e54d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.716280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232591f-4421-4a69-aa14-354d6bd3e54d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.716557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232591f-4421-4a69-aa14-354d6bd3e54d None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.717374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232591f-4421-4a69-aa14-354d6bd3e54d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:49.717720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232591f-4421-4a69-aa14-354d6bd3e54d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.720391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232591f-4421-4a69-aa14-354d6bd3e54d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.722681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130b9a-24ac-46d0-8766-30a69991eed5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.735946 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 337/687] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:49.736559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232591f-4421-4a69-aa14-354d6bd3e54d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.763016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fdf6a-2bc0-47d1-83de-414ebc70d6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.764350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fdf6a-2bc0-47d1-83de-414ebc70d6bf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.764992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fdf6a-2bc0-47d1-83de-414ebc70d6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.765477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fdf6a-2bc0-47d1-83de-414ebc70d6bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.847995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fdf6a-2bc0-47d1-83de-414ebc70d6bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.850153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fdf6a-2bc0-47d1-83de-414ebc70d6bf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.859170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232591f-4421-4a69-aa14-354d6bd3e54d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.896958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abaa8e-715f-41ed-b0af-20752aaed8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.898107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abaa8e-715f-41ed-b0af-20752aaed8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.898594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abaa8e-715f-41ed-b0af-20752aaed8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.899117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abaa8e-715f-41ed-b0af-20752aaed8b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.913898 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abaa8e-715f-41ed-b0af-20752aaed8b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.915895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abaa8e-715f-41ed-b0af-20752aaed8b5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.918029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.929534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a0abaa8e-715f-41ed-b0af-20752aaed8b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:49.938130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:49.940028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:49.940924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:49.940924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:49.940924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:49.940924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:49.946467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 338/688] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:49.947606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abaa8e-715f-41ed-b0af-20752aaed8b5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.974450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 351/689] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:49.975380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fdf6a-2bc0-47d1-83de-414ebc70d6bf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.059209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abaa8e-715f-41ed-b0af-20752aaed8b5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.095532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486e8a-8324-456e-aa47-ff35e7e36bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.096408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486e8a-8324-456e-aa47-ff35e7e36bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.096858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486e8a-8324-456e-aa47-ff35e7e36bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.097203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486e8a-8324-456e-aa47-ff35e7e36bd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.098130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76486e8a-8324-456e-aa47-ff35e7e36bd7 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=4bc0ef455caa4ee5b6b86dc1904d4e24) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:50.098514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76486e8a-8324-456e-aa47-ff35e7e36bd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.099834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fdf6a-2bc0-47d1-83de-414ebc70d6bf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.100145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76486e8a-8324-456e-aa47-ff35e7e36bd7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.108190 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 339/690] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/role_assignments?user.id=4bc0ef455caa4ee5b6b86dc1904d4e24&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:50.109320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486e8a-8324-456e-aa47-ff35e7e36bd7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.146454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b2df1-da51-42dd-98c9-d4c6160c8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.147511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b2df1-da51-42dd-98c9-d4c6160c8db8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.147740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b2df1-da51-42dd-98c9-d4c6160c8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.148019 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b2df1-da51-42dd-98c9-d4c6160c8db8 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.148758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b2df1-da51-42dd-98c9-d4c6160c8db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:50.149069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b2df1-da51-42dd-98c9-d4c6160c8db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.151463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b2df1-da51-42dd-98c9-d4c6160c8db8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.166803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 352/691] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:50.175479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b2df1-da51-42dd-98c9-d4c6160c8db8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.195735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.231672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.297689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486e8a-8324-456e-aa47-ff35e7e36bd7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.325880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b2df1-da51-42dd-98c9-d4c6160c8db8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.363824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d6a50-0501-460d-bdc4-3dfef56edee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.365293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d6a50-0501-460d-bdc4-3dfef56edee3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.365982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d6a50-0501-460d-bdc4-3dfef56edee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.366413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d6a50-0501-460d-bdc4-3dfef56edee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.369585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a73bc8-3cf4-45fb-8100-cc0759d58cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.370464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a73bc8-3cf4-45fb-8100-cc0759d58cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.370663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a73bc8-3cf4-45fb-8100-cc0759d58cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.370937 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a73bc8-3cf4-45fb-8100-cc0759d58cf6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.380588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d6a50-0501-460d-bdc4-3dfef56edee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.380767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a73bc8-3cf4-45fb-8100-cc0759d58cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.382098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a73bc8-3cf4-45fb-8100-cc0759d58cf6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.382470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d6a50-0501-460d-bdc4-3dfef56edee3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-54a73bc8-3cf4-45fb-8100-cc0759d58cf6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:50.401541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:50.402485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:50.404079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:50.404606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 353/692] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:50.407701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a73bc8-3cf4-45fb-8100-cc0759d58cf6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2f5d6a50-0501-460d-bdc4-3dfef56edee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:50.409659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:50.410514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:50.411428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:50.411428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:50.411428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:50.411428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:50.414660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 340/693] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:50.420397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d6a50-0501-460d-bdc4-3dfef56edee3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.512787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.534425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a73bc8-3cf4-45fb-8100-cc0759d58cf6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.554742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d6a50-0501-460d-bdc4-3dfef56edee3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.567764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.588316 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e9068-5d73-4720-9383-ec7e4f3edf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.589168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e9068-5d73-4720-9383-ec7e4f3edf1e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.589488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e9068-5d73-4720-9383-ec7e4f3edf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.589808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e9068-5d73-4720-9383-ec7e4f3edf1e None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.590871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e9068-5d73-4720-9383-ec7e4f3edf1e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:50.591263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e9068-5d73-4720-9383-ec7e4f3edf1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.593518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e9068-5d73-4720-9383-ec7e4f3edf1e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.598995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4427a-6536-4aa4-b793-1a48520c59af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.600005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4427a-6536-4aa4-b793-1a48520c59af None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.600489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4427a-6536-4aa4-b793-1a48520c59af None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.601275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4427a-6536-4aa4-b793-1a48520c59af None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.602512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4427a-6536-4aa4-b793-1a48520c59af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:50.603258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4427a-6536-4aa4-b793-1a48520c59af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.606096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4427a-6536-4aa4-b793-1a48520c59af None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.619287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 354/694] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:50.622553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e9068-5d73-4720-9383-ec7e4f3edf1e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.629244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 341/695] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:50.635252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4427a-6536-4aa4-b793-1a48520c59af None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.781758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e9068-5d73-4720-9383-ec7e4f3edf1e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.807187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4427a-6536-4aa4-b793-1a48520c59af None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.818124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb573b-8b5e-4a6c-aa3a-1a5dbdbc59bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.819062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb573b-8b5e-4a6c-aa3a-1a5dbdbc59bc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.819580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb573b-8b5e-4a6c-aa3a-1a5dbdbc59bc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.820080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb573b-8b5e-4a6c-aa3a-1a5dbdbc59bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.836284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.879850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b83f30-d90d-44d8-808d-780c048ff4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.880666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83f30-d90d-44d8-808d-780c048ff4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.880950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83f30-d90d-44d8-808d-780c048ff4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.881228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83f30-d90d-44d8-808d-780c048ff4b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.895068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb573b-8b5e-4a6c-aa3a-1a5dbdbc59bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.896950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb573b-8b5e-4a6c-aa3a-1a5dbdbc59bc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.899626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b83f30-d90d-44d8-808d-780c048ff4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.901165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b83f30-d90d-44d8-808d-780c048ff4b2 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-39b83f30-d90d-44d8-808d-780c048ff4b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:50.928387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:50.929337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:50.930226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:50.930226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:50.930226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:50.930226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:50.930226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:50.930226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:50.930226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:50.930226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:50.930226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 342/696] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:50.936231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b83f30-d90d-44d8-808d-780c048ff4b2 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.997739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.009251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 355/697] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:51.010625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb741bed-658f-4626-99f9-d4745902b7d8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.011120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb741bed-658f-4626-99f9-d4745902b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.011410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb741bed-658f-4626-99f9-d4745902b7d8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.012960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 356/698] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:51.016316 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb741bed-658f-4626-99f9-d4745902b7d8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.068998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.079694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b83f30-d90d-44d8-808d-780c048ff4b2 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.115554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f1a08-853e-4902-9b1b-695db00aed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.116407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f1a08-853e-4902-9b1b-695db00aed0c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.116790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f1a08-853e-4902-9b1b-695db00aed0c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.117165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f1a08-853e-4902-9b1b-695db00aed0c None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.118078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f1a08-853e-4902-9b1b-695db00aed0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.118492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f1a08-853e-4902-9b1b-695db00aed0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.120088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f1a08-853e-4902-9b1b-695db00aed0c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.133592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb741bed-658f-4626-99f9-d4745902b7d8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.135036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 343/699] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:51.136500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0c52-9ead-4b8d-8f44-6a20c8493e21 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.136944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0c52-9ead-4b8d-8f44-6a20c8493e21 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.137334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0c52-9ead-4b8d-8f44-6a20c8493e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.160586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-abef0c52-9ead-4b8d-8f44-6a20c8493e21 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:51.161791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-abef0c52-9ead-4b8d-8f44-6a20c8493e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:51.180966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcb633-28c0-47fa-8a27-69ab670509c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.182284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcb633-28c0-47fa-8a27-69ab670509c0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.182863 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcb633-28c0-47fa-8a27-69ab670509c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.183242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcb633-28c0-47fa-8a27-69ab670509c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.198202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcb633-28c0-47fa-8a27-69ab670509c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.200529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcb633-28c0-47fa-8a27-69ab670509c0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b2dcb633-28c0-47fa-8a27-69ab670509c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:51.222208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:51.223520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:51.225182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:51.225182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:51.225182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:51.225182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:51.225182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 357/700] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:51.225669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcb633-28c0-47fa-8a27-69ab670509c0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.264002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 344/701] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:51.265725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef0c52-9ead-4b8d-8f44-6a20c8493e21 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.291346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.346027 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.353171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcb633-28c0-47fa-8a27-69ab670509c0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.372977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef0c52-9ead-4b8d-8f44-6a20c8493e21 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.392262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee137a7-6ebd-4f0a-88bd-04c519361607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.393362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee137a7-6ebd-4f0a-88bd-04c519361607 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.393852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee137a7-6ebd-4f0a-88bd-04c519361607 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.394384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee137a7-6ebd-4f0a-88bd-04c519361607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.395442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee137a7-6ebd-4f0a-88bd-04c519361607 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=ffbe700a0ebc48b5953a600400ecfed5) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.396137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee137a7-6ebd-4f0a-88bd-04c519361607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.397868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee137a7-6ebd-4f0a-88bd-04c519361607 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.411213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 358/702] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/role_assignments?user.id=ffbe700a0ebc48b5953a600400ecfed5&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:51.412845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee137a7-6ebd-4f0a-88bd-04c519361607 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.415939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406765-34a7-48a3-b396-1dd0d9155903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.416701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406765-34a7-48a3-b396-1dd0d9155903 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.416982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406765-34a7-48a3-b396-1dd0d9155903 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.417254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406765-34a7-48a3-b396-1dd0d9155903 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.419504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406765-34a7-48a3-b396-1dd0d9155903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.419812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406765-34a7-48a3-b396-1dd0d9155903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.423546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406765-34a7-48a3-b396-1dd0d9155903 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.452282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 345/703] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:51.457554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406765-34a7-48a3-b396-1dd0d9155903 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.572710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.584227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee137a7-6ebd-4f0a-88bd-04c519361607 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.596852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406765-34a7-48a3-b396-1dd0d9155903 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.638257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c725b6c-7e06-4cdd-991f-d749cf946b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.639494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c725b6c-7e06-4cdd-991f-d749cf946b60 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.639884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c725b6c-7e06-4cdd-991f-d749cf946b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.640167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c725b6c-7e06-4cdd-991f-d749cf946b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.642219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac725363-8e0a-4da3-9c2a-eae48fb9bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.643280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac725363-8e0a-4da3-9c2a-eae48fb9bbbc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.643733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac725363-8e0a-4da3-9c2a-eae48fb9bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.644164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac725363-8e0a-4da3-9c2a-eae48fb9bbbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.654964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c725b6c-7e06-4cdd-991f-d749cf946b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.655541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac725363-8e0a-4da3-9c2a-eae48fb9bbbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.656552 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c725b6c-7e06-4cdd-991f-d749cf946b60 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.656968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac725363-8e0a-4da3-9c2a-eae48fb9bbbc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ac725363-8e0a-4da3-9c2a-eae48fb9bbbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:51.672910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:51.673876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:51.675270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:51.675270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:51.675270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:51.675270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:51.675270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:51.675270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:51.675270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:51.675270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:51.675270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 346/704] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:51.675766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315e03e-bdd8-4aea-b8a0-529eb15c0d43 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.676069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315e03e-bdd8-4aea-b8a0-529eb15c0d43 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.677223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315e03e-bdd8-4aea-b8a0-529eb15c0d43 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3c725b6c-7e06-4cdd-991f-d749cf946b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:51.677329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:51.679802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:51.680923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:51.680923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:51.680923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:51.680923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:51.682981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 347/705] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:51.683168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 359/706] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:51.684579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315e03e-bdd8-4aea-b8a0-529eb15c0d43 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.685759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc361a3-a54f-4993-9e79-a215315b35b7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.686047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc361a3-a54f-4993-9e79-a215315b35b7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.686323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc361a3-a54f-4993-9e79-a215315b35b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.707220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-edc361a3-a54f-4993-9e79-a215315b35b7 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:51.708427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-edc361a3-a54f-4993-9e79-a215315b35b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:51.717488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.803319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 360/707] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:51.804743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc361a3-a54f-4993-9e79-a215315b35b7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.813568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315e03e-bdd8-4aea-b8a0-529eb15c0d43 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.858963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86c1e-9ba9-4cab-b4f4-4dae72837812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.859710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86c1e-9ba9-4cab-b4f4-4dae72837812 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.859992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86c1e-9ba9-4cab-b4f4-4dae72837812 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.860263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86c1e-9ba9-4cab-b4f4-4dae72837812 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.861493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86c1e-9ba9-4cab-b4f4-4dae72837812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.861859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86c1e-9ba9-4cab-b4f4-4dae72837812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.863722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86c1e-9ba9-4cab-b4f4-4dae72837812 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.875234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.880718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 348/708] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:51.886566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86c1e-9ba9-4cab-b4f4-4dae72837812 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.914001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc361a3-a54f-4993-9e79-a215315b35b7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.961728 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f8521-cdd8-43f3-b816-36cf143fe294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.962527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f8521-cdd8-43f3-b816-36cf143fe294 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.962813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f8521-cdd8-43f3-b816-36cf143fe294 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.963081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f8521-cdd8-43f3-b816-36cf143fe294 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.964075 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f8521-cdd8-43f3-b816-36cf143fe294 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.964385 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f8521-cdd8-43f3-b816-36cf143fe294 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.966874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f8521-cdd8-43f3-b816-36cf143fe294 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.982275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 361/709] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:51.983195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f8521-cdd8-43f3-b816-36cf143fe294 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.986447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:52.016702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86c1e-9ba9-4cab-b4f4-4dae72837812 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.060471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aaf91-1e9f-4473-b3e9-df9f2ba89582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.061976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aaf91-1e9f-4473-b3e9-df9f2ba89582 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.062542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aaf91-1e9f-4473-b3e9-df9f2ba89582 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.062960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aaf91-1e9f-4473-b3e9-df9f2ba89582 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.064458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aaf91-1e9f-4473-b3e9-df9f2ba89582 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.066682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aaf91-1e9f-4473-b3e9-df9f2ba89582 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-412aaf91-1e9f-4473-b3e9-df9f2ba89582 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:52.085481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:52.086698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:52.087779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:52.090519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 349/710] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:52.091568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aaf91-1e9f-4473-b3e9-df9f2ba89582 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:52.107758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f8521-cdd8-43f3-b816-36cf143fe294 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.159197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714bd2-c61b-47a4-99db-7734c8823773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.159197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714bd2-c61b-47a4-99db-7734c8823773 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.159197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714bd2-c61b-47a4-99db-7734c8823773 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.159197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714bd2-c61b-47a4-99db-7734c8823773 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.159626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c714bd2-c61b-47a4-99db-7734c8823773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.159626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c714bd2-c61b-47a4-99db-7734c8823773 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.171438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:52.210020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aaf91-1e9f-4473-b3e9-df9f2ba89582 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.234189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 362/711] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:51 2022] POST /identity/v3/users => generated 254 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:52.235954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714bd2-c61b-47a4-99db-7734c8823773 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:52.288022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf34364-dae3-4f79-b4f0-ebf40cdf9041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.288466 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34364-dae3-4f79-b4f0-ebf40cdf9041 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.288823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34364-dae3-4f79-b4f0-ebf40cdf9041 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.289163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34364-dae3-4f79-b4f0-ebf40cdf9041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.290128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf34364-dae3-4f79-b4f0-ebf40cdf9041 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=0b0591179ec144f5a90c9a24205b6b47) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:52.290509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf34364-dae3-4f79-b4f0-ebf40cdf9041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.299028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf34364-dae3-4f79-b4f0-ebf40cdf9041 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.307903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 350/712] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:52 2022] GET /identity/v3/role_assignments?user.id=0b0591179ec144f5a90c9a24205b6b47&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:52.315492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:52.394992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714bd2-c61b-47a4-99db-7734c8823773 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.446657 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbd462-ca40-41c2-b7a1-f796032bf042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.447305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbd462-ca40-41c2-b7a1-f796032bf042 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.447593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbd462-ca40-41c2-b7a1-f796032bf042 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.447875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbd462-ca40-41c2-b7a1-f796032bf042 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.448630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbd462-ca40-41c2-b7a1-f796032bf042 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:52.448944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbd462-ca40-41c2-b7a1-f796032bf042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.450660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbd462-ca40-41c2-b7a1-f796032bf042 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.456593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 363/713] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:52.461893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf34364-dae3-4f79-b4f0-ebf40cdf9041 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:52.595702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf34364-dae3-4f79-b4f0-ebf40cdf9041 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.624182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:52.635801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019cdca-5517-4f4d-aebf-4dd70fabce3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.636534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019cdca-5517-4f4d-aebf-4dd70fabce3a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.636853 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019cdca-5517-4f4d-aebf-4dd70fabce3a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.637139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019cdca-5517-4f4d-aebf-4dd70fabce3a None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.640459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019cdca-5517-4f4d-aebf-4dd70fabce3a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:52.640459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019cdca-5517-4f4d-aebf-4dd70fabce3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.640459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019cdca-5517-4f4d-aebf-4dd70fabce3a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.646146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 351/714] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:52.877067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a97be3-cf02-4595-b8d8-e2dec715ff86 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.877584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a97be3-cf02-4595-b8d8-e2dec715ff86 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.877695 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a97be3-cf02-4595-b8d8-e2dec715ff86 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.879129 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 364/715] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:52.884732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdfb54-b248-4b7d-86a2-456b123cac9b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.885169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdfb54-b248-4b7d-86a2-456b123cac9b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.885372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdfb54-b248-4b7d-86a2-456b123cac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.903305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-72fdfb54-b248-4b7d-86a2-456b123cac9b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:52.904501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-72fdfb54-b248-4b7d-86a2-456b123cac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:52.985793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 352/716] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:53.008472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a97be3-cf02-4595-b8d8-e2dec715ff86 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:53.147690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a97be3-cf02-4595-b8d8-e2dec715ff86 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:53.177534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:53.197675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e4c12-627a-449d-bcef-efb4cd4027e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:53.198475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e4c12-627a-449d-bcef-efb4cd4027e3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:53.198755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e4c12-627a-449d-bcef-efb4cd4027e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:53.199026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e4c12-627a-449d-bcef-efb4cd4027e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:53.199739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e4c12-627a-449d-bcef-efb4cd4027e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:53.209785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e4c12-627a-449d-bcef-efb4cd4027e3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7a9e4c12-627a-449d-bcef-efb4cd4027e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:53.221241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:53.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:53.223046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 365/717] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:53 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:53.236226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdfb54-b248-4b7d-86a2-456b123cac9b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:53.356156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdfb54-b248-4b7d-86a2-456b123cac9b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:53.398470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:53.418861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ec7a9-370b-4e05-92b6-9033e569a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:53.419576 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec7a9-370b-4e05-92b6-9033e569a802 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:53.419862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec7a9-370b-4e05-92b6-9033e569a802 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:53.420135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec7a9-370b-4e05-92b6-9033e569a802 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:53.420847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec7a9-370b-4e05-92b6-9033e569a802 None admin] RBAC: Adding query filter params (name=network) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:53.423661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec7a9-370b-4e05-92b6-9033e569a802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:53.423661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec7a9-370b-4e05-92b6-9033e569a802 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:53.427608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 353/718] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:54:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:53.432995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e4c12-627a-449d-bcef-efb4cd4027e3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:53.593393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e4c12-627a-449d-bcef-efb4cd4027e3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:53.642190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58abf0-ae7d-4a87-ae6a-8f1169df4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:53.642865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58abf0-ae7d-4a87-ae6a-8f1169df4544 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:53.643176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58abf0-ae7d-4a87-ae6a-8f1169df4544 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:53.643456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58abf0-ae7d-4a87-ae6a-8f1169df4544 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:53.644166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58abf0-ae7d-4a87-ae6a-8f1169df4544 None admin] RBAC: Adding query filter params (type=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:53.644476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58abf0-ae7d-4a87-ae6a-8f1169df4544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:53.645861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58abf0-ae7d-4a87-ae6a-8f1169df4544 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:53.651969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 366/719] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:54:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:54.162188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b6509-df9b-483f-af13-b3b24071a8d2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.163239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b6509-df9b-483f-af13-b3b24071a8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.163749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b6509-df9b-483f-af13-b3b24071a8d2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.165550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 354/720] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:54.171179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b626-7c46-4bf2-8ac4-84eb2fb2fb0b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.171979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b626-7c46-4bf2-8ac4-84eb2fb2fb0b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.172454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474b626-7c46-4bf2-8ac4-84eb2fb2fb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.196550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b474b626-7c46-4bf2-8ac4-84eb2fb2fb0b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:54.198097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b474b626-7c46-4bf2-8ac4-84eb2fb2fb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:54.267808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:54.300108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 367/721] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:54.341399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b6509-df9b-483f-af13-b3b24071a8d2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:54.472845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b6509-df9b-483f-af13-b3b24071a8d2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:54.518629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9e5c3-e2e2-46eb-83d2-ed6d2490ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:54.519461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9e5c3-e2e2-46eb-83d2-ed6d2490ca37 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.519745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9e5c3-e2e2-46eb-83d2-ed6d2490ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.520017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9e5c3-e2e2-46eb-83d2-ed6d2490ca37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.536347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9e5c3-e2e2-46eb-83d2-ed6d2490ca37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-82d9e5c3-e2e2-46eb-83d2-ed6d2490ca37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:54.544036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:54.544963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:54.546211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 355/722] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:54.552973 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474b626-7c46-4bf2-8ac4-84eb2fb2fb0b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:54.679366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474b626-7c46-4bf2-8ac4-84eb2fb2fb0b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:54.722686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec77c-b28b-4c13-a4e6-de9d158f79fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:54.723448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec77c-b28b-4c13-a4e6-de9d158f79fb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.723680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec77c-b28b-4c13-a4e6-de9d158f79fb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.723959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec77c-b28b-4c13-a4e6-de9d158f79fb None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.724708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec77c-b28b-4c13-a4e6-de9d158f79fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:54.725015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec77c-b28b-4c13-a4e6-de9d158f79fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:54.726380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec77c-b28b-4c13-a4e6-de9d158f79fb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:54.739462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 368/723] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:54.741475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9e5c3-e2e2-46eb-83d2-ed6d2490ca37 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:54.814337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:54.872153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9e5c3-e2e2-46eb-83d2-ed6d2490ca37 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:54.914755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b26093-9951-4bc4-9419-d9a485e4084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:54.915597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b26093-9951-4bc4-9419-d9a485e4084f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.915883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b26093-9951-4bc4-9419-d9a485e4084f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.916158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b26093-9951-4bc4-9419-d9a485e4084f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.929489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b26093-9951-4bc4-9419-d9a485e4084f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:54.930930 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b26093-9951-4bc4-9419-d9a485e4084f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-72b26093-9951-4bc4-9419-d9a485e4084f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:54.957028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:54.957969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:54.959385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:54.959385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:54.959385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:54.959385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:54.959385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 356/724] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:54.965663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec77c-b28b-4c13-a4e6-de9d158f79fb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.011462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.088703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec77c-b28b-4c13-a4e6-de9d158f79fb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.130585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfafb6-5eb7-4441-a0f4-0eec95fa55f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.131284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfafb6-5eb7-4441-a0f4-0eec95fa55f4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.131567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfafb6-5eb7-4441-a0f4-0eec95fa55f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.131841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfafb6-5eb7-4441-a0f4-0eec95fa55f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.132559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfafb6-5eb7-4441-a0f4-0eec95fa55f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:55.132867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfafb6-5eb7-4441-a0f4-0eec95fa55f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.134219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfafb6-5eb7-4441-a0f4-0eec95fa55f4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.146605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 369/725] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:55.153087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b26093-9951-4bc4-9419-d9a485e4084f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.221583 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e07d9-00e1-4263-ad5f-01d78ec2d4eb None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.222106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e07d9-00e1-4263-ad5f-01d78ec2d4eb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.222106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e07d9-00e1-4263-ad5f-01d78ec2d4eb None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.223863 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 370/726] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:55.229057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33defd-2535-49fc-88a9-966489482550 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.229333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33defd-2535-49fc-88a9-966489482550 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.229598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33defd-2535-49fc-88a9-966489482550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.276762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ca33defd-2535-49fc-88a9-966489482550 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:55.278530 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ca33defd-2535-49fc-88a9-966489482550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:55.306977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.311085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b26093-9951-4bc4-9419-d9a485e4084f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.352980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a3feb-a77b-4241-9fcd-bad876c7c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.353786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a3feb-a77b-4241-9fcd-bad876c7c081 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.354071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a3feb-a77b-4241-9fcd-bad876c7c081 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.354346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a3feb-a77b-4241-9fcd-bad876c7c081 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.364610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a3feb-a77b-4241-9fcd-bad876c7c081 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.366330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a3feb-a77b-4241-9fcd-bad876c7c081 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.376862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 371/727] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:55.378430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f99e52-b818-4811-9042-6d58891a1700 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.378893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f99e52-b818-4811-9042-6d58891a1700 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.379341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f99e52-b818-4811-9042-6d58891a1700 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.381028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 372/728] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8f6a3feb-a77b-4241-9fcd-bad876c7c081 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:55.382243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:55.383241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:55.384208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 357/729] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:55.387311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199c3d-0625-4e6b-bce6-77b5236bbb05 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.387837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199c3d-0625-4e6b-bce6-77b5236bbb05 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.388337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24199c3d-0625-4e6b-bce6-77b5236bbb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.389532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a3feb-a77b-4241-9fcd-bad876c7c081 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.425027 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-24199c3d-0625-4e6b-bce6-77b5236bbb05 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:55.427070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-24199c3d-0625-4e6b-bce6-77b5236bbb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:55.460712 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.516646 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 373/730] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:55.518605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24199c3d-0625-4e6b-bce6-77b5236bbb05 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.520526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a3feb-a77b-4241-9fcd-bad876c7c081 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.570165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b660ef3-e524-4dc1-b92f-168bb7a09337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.571175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b660ef3-e524-4dc1-b92f-168bb7a09337 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.571764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b660ef3-e524-4dc1-b92f-168bb7a09337 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.572214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b660ef3-e524-4dc1-b92f-168bb7a09337 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.573324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b660ef3-e524-4dc1-b92f-168bb7a09337 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:55.574365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b660ef3-e524-4dc1-b92f-168bb7a09337 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.576009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b660ef3-e524-4dc1-b92f-168bb7a09337 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.596435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 358/731] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:55.597556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b660ef3-e524-4dc1-b92f-168bb7a09337 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.615273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.640089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24199c3d-0625-4e6b-bce6-77b5236bbb05 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.678154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057551c6-dcb5-4bf2-a512-8f366ee5837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.678946 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057551c6-dcb5-4bf2-a512-8f366ee5837c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.679266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057551c6-dcb5-4bf2-a512-8f366ee5837c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.679541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057551c6-dcb5-4bf2-a512-8f366ee5837c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.690746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057551c6-dcb5-4bf2-a512-8f366ee5837c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:55.697470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b660ef3-e524-4dc1-b92f-168bb7a09337 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-057551c6-dcb5-4bf2-a512-8f366ee5837c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:55.698280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:55.699816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:55.700658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 374/732] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:55.701368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baabf5e-ee74-48c6-8ee7-6bf7df1e5459 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.702054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baabf5e-ee74-48c6-8ee7-6bf7df1e5459 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.702054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baabf5e-ee74-48c6-8ee7-6bf7df1e5459 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.707843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 375/733] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:55.707843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baabf5e-ee74-48c6-8ee7-6bf7df1e5459 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.732284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.740505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eb3f4-3a1d-488d-8a30-eb993f300bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.741289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eb3f4-3a1d-488d-8a30-eb993f300bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.741571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eb3f4-3a1d-488d-8a30-eb993f300bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.745146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eb3f4-3a1d-488d-8a30-eb993f300bc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.752041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eb3f4-3a1d-488d-8a30-eb993f300bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5d6eb3f4-3a1d-488d-8a30-eb993f300bc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:55.759578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:55.760694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 359/734] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:55.762033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eb3f4-3a1d-488d-8a30-eb993f300bc3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.818200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baabf5e-ee74-48c6-8ee7-6bf7df1e5459 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.840514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.854134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1317c1-3031-499a-b60f-a2a3c9fbcc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.854785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1317c1-3031-499a-b60f-a2a3c9fbcc26 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.855108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1317c1-3031-499a-b60f-a2a3c9fbcc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.855408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1317c1-3031-499a-b60f-a2a3c9fbcc26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.862301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eb3f4-3a1d-488d-8a30-eb993f300bc3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.902744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7bfc0-d639-4a3e-8e7e-8328b2366d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.903731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7bfc0-d639-4a3e-8e7e-8328b2366d94 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.904227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7bfc0-d639-4a3e-8e7e-8328b2366d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.904498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7bfc0-d639-4a3e-8e7e-8328b2366d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.905235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7bfc0-d639-4a3e-8e7e-8328b2366d94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:55.905537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7bfc0-d639-4a3e-8e7e-8328b2366d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.906885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7bfc0-d639-4a3e-8e7e-8328b2366d94 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.919225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 360/735] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:55.919225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdda6a-2ef5-4cb1-b99e-783f7a8a6a81 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.919225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdda6a-2ef5-4cb1-b99e-783f7a8a6a81 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.919225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdda6a-2ef5-4cb1-b99e-783f7a8a6a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.932794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7cfdda6a-2ef5-4cb1-b99e-783f7a8a6a81 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:55.934421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7cfdda6a-2ef5-4cb1-b99e-783f7a8a6a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:55.934530 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1317c1-3031-499a-b60f-a2a3c9fbcc26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.935904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1317c1-3031-499a-b60f-a2a3c9fbcc26 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.964211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.005872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 361/736] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:56.006714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdda6a-2ef5-4cb1-b99e-783f7a8a6a81 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.065988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 376/737] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:56.065988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1317c1-3031-499a-b60f-a2a3c9fbcc26 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.082429 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.123715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdda6a-2ef5-4cb1-b99e-783f7a8a6a81 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.161102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aead1-03e7-4478-acef-685866341094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.161948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aead1-03e7-4478-acef-685866341094 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.162297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aead1-03e7-4478-acef-685866341094 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.162655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aead1-03e7-4478-acef-685866341094 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.163546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aead1-03e7-4478-acef-685866341094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:56.163942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aead1-03e7-4478-acef-685866341094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.165595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aead1-03e7-4478-acef-685866341094 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.168560 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1317c1-3031-499a-b60f-a2a3c9fbcc26 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.179188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 362/738] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:56.179188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aead1-03e7-4478-acef-685866341094 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.195458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.208038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa575b-6b0c-4983-be75-a5fd7a1809a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.209073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa575b-6b0c-4983-be75-a5fd7a1809a1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.209425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa575b-6b0c-4983-be75-a5fd7a1809a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.209767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa575b-6b0c-4983-be75-a5fd7a1809a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.220723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa575b-6b0c-4983-be75-a5fd7a1809a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.222223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa575b-6b0c-4983-be75-a5fd7a1809a1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a1fa575b-6b0c-4983-be75-a5fd7a1809a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:56.239842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:56.240951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:56.241986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:56.241986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:56.241986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:56.241986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:56.241986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 377/739] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:56.246268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa575b-6b0c-4983-be75-a5fd7a1809a1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.302532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aead1-03e7-4478-acef-685866341094 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.332293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.351361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c08261-1411-47eb-bfe9-63dafa6e07f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.351361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c08261-1411-47eb-bfe9-63dafa6e07f1 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.351361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c08261-1411-47eb-bfe9-63dafa6e07f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.351361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c08261-1411-47eb-bfe9-63dafa6e07f1 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.351810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c08261-1411-47eb-bfe9-63dafa6e07f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.351810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c08261-1411-47eb-bfe9-63dafa6e07f1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.352182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa575b-6b0c-4983-be75-a5fd7a1809a1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.386673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998cdc2-4142-4cc3-a55e-1235bd0bdd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.387503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998cdc2-4142-4cc3-a55e-1235bd0bdd75 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.387784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998cdc2-4142-4cc3-a55e-1235bd0bdd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.388056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998cdc2-4142-4cc3-a55e-1235bd0bdd75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.398220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998cdc2-4142-4cc3-a55e-1235bd0bdd75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.399742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998cdc2-4142-4cc3-a55e-1235bd0bdd75 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-8998cdc2-4142-4cc3-a55e-1235bd0bdd75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:56.418517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:56.419625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:56.425430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:56.425430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:56.425430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:56.425430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:56.425430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 378/740] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:56.425430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998cdc2-4142-4cc3-a55e-1235bd0bdd75 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.446820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.463223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 363/741] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:54:56 2022] POST /identity/v3/services => generated 251 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:56.464056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c08261-1411-47eb-bfe9-63dafa6e07f1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.538922 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998cdc2-4142-4cc3-a55e-1235bd0bdd75 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.585571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a706c-0a89-4106-b2e4-8b268119def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.586500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a706c-0a89-4106-b2e4-8b268119def5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.586782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a706c-0a89-4106-b2e4-8b268119def5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.587053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a706c-0a89-4106-b2e4-8b268119def5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.591356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c08261-1411-47eb-bfe9-63dafa6e07f1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.598659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a706c-0a89-4106-b2e4-8b268119def5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.600167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a706c-0a89-4106-b2e4-8b268119def5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-601a706c-0a89-4106-b2e4-8b268119def5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:56.619725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:56.621165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:56.622045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:56.622045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:56.622045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:56.622045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:56.622045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 379/742] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:56.622325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a706c-0a89-4106-b2e4-8b268119def5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.634198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83103-2c18-4405-8dfd-f5e4d6aab151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.634885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83103-2c18-4405-8dfd-f5e4d6aab151 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.635200 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83103-2c18-4405-8dfd-f5e4d6aab151 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.635480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83103-2c18-4405-8dfd-f5e4d6aab151 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.637132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f83103-2c18-4405-8dfd-f5e4d6aab151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:56.637132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f83103-2c18-4405-8dfd-f5e4d6aab151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.638470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f83103-2c18-4405-8dfd-f5e4d6aab151 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.651195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 364/743] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:56.653270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4780aee-8ce5-4832-bfa7-842255081cbd None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.653561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4780aee-8ce5-4832-bfa7-842255081cbd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.653841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4780aee-8ce5-4832-bfa7-842255081cbd None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.655409 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 365/744] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:56.656386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4780aee-8ce5-4832-bfa7-842255081cbd None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.711023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.719690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.744294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a706c-0a89-4106-b2e4-8b268119def5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.775149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4780aee-8ce5-4832-bfa7-842255081cbd None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.778922 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3d4e-dcb3-41a8-b4bb-7e2db401d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.779604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3d4e-dcb3-41a8-b4bb-7e2db401d23e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.779878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3d4e-dcb3-41a8-b4bb-7e2db401d23e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.780148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3d4e-dcb3-41a8-b4bb-7e2db401d23e None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.780860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3d4e-dcb3-41a8-b4bb-7e2db401d23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:56.781161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3d4e-dcb3-41a8-b4bb-7e2db401d23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.782518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3d4e-dcb3-41a8-b4bb-7e2db401d23e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.795155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 380/745] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:56.795963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3d4e-dcb3-41a8-b4bb-7e2db401d23e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.814786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61702d18-7b4e-4f8a-9784-406a90c17e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.815785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702d18-7b4e-4f8a-9784-406a90c17e17 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.816241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702d18-7b4e-4f8a-9784-406a90c17e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.816528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702d18-7b4e-4f8a-9784-406a90c17e17 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.817511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61702d18-7b4e-4f8a-9784-406a90c17e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:56.818061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61702d18-7b4e-4f8a-9784-406a90c17e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.820043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61702d18-7b4e-4f8a-9784-406a90c17e17 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.837387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 366/746] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:56.837387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b491b-5992-4df5-b31e-20b818e030a3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.837387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b491b-5992-4df5-b31e-20b818e030a3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.837387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b491b-5992-4df5-b31e-20b818e030a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.853057 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1e4b491b-5992-4df5-b31e-20b818e030a3 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:56.854255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1e4b491b-5992-4df5-b31e-20b818e030a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:56.946400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3d4e-dcb3-41a8-b4bb-7e2db401d23e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.955159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 367/747] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:56.955159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b491b-5992-4df5-b31e-20b818e030a3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.984970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.995284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d7297-5e11-48cc-8c12-eb929135dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.996862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d7297-5e11-48cc-8c12-eb929135dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.000152 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d7297-5e11-48cc-8c12-eb929135dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.000152 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d7297-5e11-48cc-8c12-eb929135dfb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.000152 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.006406 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d7297-5e11-48cc-8c12-eb929135dfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.007864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d7297-5e11-48cc-8c12-eb929135dfb4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1f2d7297-5e11-48cc-8c12-eb929135dfb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:57.022210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:57.028727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 381/748] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:57.029876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d7297-5e11-48cc-8c12-eb929135dfb4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.057805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b491b-5992-4df5-b31e-20b818e030a3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.096008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e61f7b-3493-413b-8b3e-c8e6163f04a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.096802 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e61f7b-3493-413b-8b3e-c8e6163f04a8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.097082 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e61f7b-3493-413b-8b3e-c8e6163f04a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.097379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e61f7b-3493-413b-8b3e-c8e6163f04a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.104575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e61f7b-3493-413b-8b3e-c8e6163f04a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.106548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e61f7b-3493-413b-8b3e-c8e6163f04a8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-53e61f7b-3493-413b-8b3e-c8e6163f04a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:57.120229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:57.121770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:57.122666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:57.122666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:57.122666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:57.122666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:57.122666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:57.122666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:57.122666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:57.122666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:57.122666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 368/749] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:57.123913 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e61f7b-3493-413b-8b3e-c8e6163f04a8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.139647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d7297-5e11-48cc-8c12-eb929135dfb4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.175132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeed61-d2d3-450a-b6f8-dc243f01cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.176195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeed61-d2d3-450a-b6f8-dc243f01cbec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.176478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeed61-d2d3-450a-b6f8-dc243f01cbec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.176756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeed61-d2d3-450a-b6f8-dc243f01cbec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.185074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeed61-d2d3-450a-b6f8-dc243f01cbec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.186520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeed61-d2d3-450a-b6f8-dc243f01cbec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c2aeed61-d2d3-450a-b6f8-dc243f01cbec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:57.200639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:57.201585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 382/750] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:57.207354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeed61-d2d3-450a-b6f8-dc243f01cbec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.227572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.234005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e61f7b-3493-413b-8b3e-c8e6163f04a8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.268633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.275118 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8e875-9f1f-46e8-9ded-5287f1c2f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.276136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8e875-9f1f-46e8-9ded-5287f1c2f8eb None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.277373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8e875-9f1f-46e8-9ded-5287f1c2f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.277895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8e875-9f1f-46e8-9ded-5287f1c2f8eb None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.278633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8e875-9f1f-46e8-9ded-5287f1c2f8eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.280037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8e875-9f1f-46e8-9ded-5287f1c2f8eb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.315554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeed61-d2d3-450a-b6f8-dc243f01cbec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.333761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 369/751] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:54:57 2022] POST /identity/v3/services => generated 240 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:57.335147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8e875-9f1f-46e8-9ded-5287f1c2f8eb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.370755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a8b79-4de4-414a-8dfe-7887f3cd241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.370755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a8b79-4de4-414a-8dfe-7887f3cd241b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.370755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a8b79-4de4-414a-8dfe-7887f3cd241b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.370755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a8b79-4de4-414a-8dfe-7887f3cd241b None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.371340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a8b79-4de4-414a-8dfe-7887f3cd241b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:57.371340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a8b79-4de4-414a-8dfe-7887f3cd241b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.371906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a8b79-4de4-414a-8dfe-7887f3cd241b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.397603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 383/752] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:57.403508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a8b79-4de4-414a-8dfe-7887f3cd241b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.510242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8e875-9f1f-46e8-9ded-5287f1c2f8eb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.524529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a8b79-4de4-414a-8dfe-7887f3cd241b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.551513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.557631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c7a4d-6d06-47a5-a3d0-1e7983e2ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.558334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c7a4d-6d06-47a5-a3d0-1e7983e2ec96 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.559348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c7a4d-6d06-47a5-a3d0-1e7983e2ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.559348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c7a4d-6d06-47a5-a3d0-1e7983e2ec96 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.559688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c7a4d-6d06-47a5-a3d0-1e7983e2ec96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:57.559997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c7a4d-6d06-47a5-a3d0-1e7983e2ec96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.561444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c7a4d-6d06-47a5-a3d0-1e7983e2ec96 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.571125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599b45d-1027-4873-9e82-284b8dad497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.572129 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599b45d-1027-4873-9e82-284b8dad497a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.572615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599b45d-1027-4873-9e82-284b8dad497a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.573093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599b45d-1027-4873-9e82-284b8dad497a None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.574161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599b45d-1027-4873-9e82-284b8dad497a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:57.574688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599b45d-1027-4873-9e82-284b8dad497a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.577236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599b45d-1027-4873-9e82-284b8dad497a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.578981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 370/753] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:57.580221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c7a4d-6d06-47a5-a3d0-1e7983e2ec96 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.600024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 384/754] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:57.601216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599b45d-1027-4873-9e82-284b8dad497a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.611184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.706227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c7a4d-6d06-47a5-a3d0-1e7983e2ec96 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.738362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599b45d-1027-4873-9e82-284b8dad497a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.742082 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24785874-493f-48a2-87d8-d88df7414495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.742738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24785874-493f-48a2-87d8-d88df7414495 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.743020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24785874-493f-48a2-87d8-d88df7414495 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.743324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24785874-493f-48a2-87d8-d88df7414495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.790005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3021-6f6d-490f-95a0-405e5bbe8fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.791340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3021-6f6d-490f-95a0-405e5bbe8fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.791832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3021-6f6d-490f-95a0-405e5bbe8fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.792519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3021-6f6d-490f-95a0-405e5bbe8fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.794022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d3021-6f6d-490f-95a0-405e5bbe8fe7 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=ffbe700a0ebc48b5953a600400ecfed5) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:57.794759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d3021-6f6d-490f-95a0-405e5bbe8fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.797057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d3021-6f6d-490f-95a0-405e5bbe8fe7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.804998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 385/755] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/role_assignments?user.id=ffbe700a0ebc48b5953a600400ecfed5&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:57.806619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3021-6f6d-490f-95a0-405e5bbe8fe7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.816733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24785874-493f-48a2-87d8-d88df7414495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.818251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24785874-493f-48a2-87d8-d88df7414495 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.838133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.850631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.939628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3021-6f6d-490f-95a0-405e5bbe8fe7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.992966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93c5a9-c7c7-4e95-b9ad-e004624d2fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.994714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93c5a9-c7c7-4e95-b9ad-e004624d2fed None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.994998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93c5a9-c7c7-4e95-b9ad-e004624d2fed None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.995295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93c5a9-c7c7-4e95-b9ad-e004624d2fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.020027 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93c5a9-c7c7-4e95-b9ad-e004624d2fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.021499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93c5a9-c7c7-4e95-b9ad-e004624d2fed None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.035548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 371/756] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:54:58.043914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24785874-493f-48a2-87d8-d88df7414495 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5b93c5a9-c7c7-4e95-b9ad-e004624d2fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:58.054864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:58.056788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:58.057667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:58.057667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:58.057667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:58.057667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:58.064673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 386/757] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:58.070827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93c5a9-c7c7-4e95-b9ad-e004624d2fed None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.196837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:58.218414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93c5a9-c7c7-4e95-b9ad-e004624d2fed None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.261689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86d2a2-4a88-43e1-99b5-561de08a8c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.262297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24785874-493f-48a2-87d8-d88df7414495 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.262478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d2a2-4a88-43e1-99b5-561de08a8c78 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.262744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d2a2-4a88-43e1-99b5-561de08a8c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.263016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d2a2-4a88-43e1-99b5-561de08a8c78 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.263777 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d2a2-4a88-43e1-99b5-561de08a8c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:58.264280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d2a2-4a88-43e1-99b5-561de08a8c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.265669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d2a2-4a88-43e1-99b5-561de08a8c78 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.280864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 387/758] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:58.286627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86d2a2-4a88-43e1-99b5-561de08a8c78 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.301132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:58.341673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043b6da-19e8-41e0-8e8d-a785543b8177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.342478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043b6da-19e8-41e0-8e8d-a785543b8177 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.342756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043b6da-19e8-41e0-8e8d-a785543b8177 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.343024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043b6da-19e8-41e0-8e8d-a785543b8177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.367798 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043b6da-19e8-41e0-8e8d-a785543b8177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.369481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043b6da-19e8-41e0-8e8d-a785543b8177 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.399805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86d2a2-4a88-43e1-99b5-561de08a8c78 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8043b6da-19e8-41e0-8e8d-a785543b8177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:58.406498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:58.407440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:58.408320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:58.408320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:58.408320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:58.408320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:58.408320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 372/759] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:58.415138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043b6da-19e8-41e0-8e8d-a785543b8177 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.445980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617df13e-0196-4b11-80c8-f1b8f7d8005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.446806 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617df13e-0196-4b11-80c8-f1b8f7d8005d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.447085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617df13e-0196-4b11-80c8-f1b8f7d8005d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.447393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617df13e-0196-4b11-80c8-f1b8f7d8005d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.456190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617df13e-0196-4b11-80c8-f1b8f7d8005d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.457663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617df13e-0196-4b11-80c8-f1b8f7d8005d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-617df13e-0196-4b11-80c8-f1b8f7d8005d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:58.475193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:58.476387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:58.477477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:58.477477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:58.477477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:58.477477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:58.477477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:58.477477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:58.477477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:58.477477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:58.477477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 388/760] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:58.483288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617df13e-0196-4b11-80c8-f1b8f7d8005d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.486257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:58.634238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043b6da-19e8-41e0-8e8d-a785543b8177 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.658405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617df13e-0196-4b11-80c8-f1b8f7d8005d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.696614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe44908-2dae-475c-8530-270bf116b8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.697286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44908-2dae-475c-8530-270bf116b8ea None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.697565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44908-2dae-475c-8530-270bf116b8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.697840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44908-2dae-475c-8530-270bf116b8ea None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.699107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe44908-2dae-475c-8530-270bf116b8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:58.699499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe44908-2dae-475c-8530-270bf116b8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.701185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe44908-2dae-475c-8530-270bf116b8ea None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.704799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458a050-1d06-4f31-8fb7-6d5f0c50de4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.705464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458a050-1d06-4f31-8fb7-6d5f0c50de4e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.705743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458a050-1d06-4f31-8fb7-6d5f0c50de4e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.706013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458a050-1d06-4f31-8fb7-6d5f0c50de4e None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.706853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458a050-1d06-4f31-8fb7-6d5f0c50de4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:58.707184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458a050-1d06-4f31-8fb7-6d5f0c50de4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.708652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458a050-1d06-4f31-8fb7-6d5f0c50de4e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.713878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 373/761] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:58.720063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe44908-2dae-475c-8530-270bf116b8ea None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.740418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 389/762] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:58.749214 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458a050-1d06-4f31-8fb7-6d5f0c50de4e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.755745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:58.831307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe44908-2dae-475c-8530-270bf116b8ea None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.842976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:58.867796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ffb8-bc93-4031-a4af-f8e2c2d7c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.868846 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ffb8-bc93-4031-a4af-f8e2c2d7c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.869271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ffb8-bc93-4031-a4af-f8e2c2d7c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.869748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ffb8-bc93-4031-a4af-f8e2c2d7c9c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.877115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670ffb8-bc93-4031-a4af-f8e2c2d7c9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.878779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670ffb8-bc93-4031-a4af-f8e2c2d7c9c6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.883222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458a050-1d06-4f31-8fb7-6d5f0c50de4e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d670ffb8-bc93-4031-a4af-f8e2c2d7c9c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:58.893711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:58.894574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:58.895486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:58.895486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:58.895486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:58.895486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:58.895486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:58.895486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:58.895486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:58.895486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:54:58.897455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 374/763] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:58.903734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef3f11-f4d8-4aef-b215-ead67b884a17 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.904571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef3f11-f4d8-4aef-b215-ead67b884a17 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.905005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef3f11-f4d8-4aef-b215-ead67b884a17 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.906755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 375/764] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:58.907859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef3f11-f4d8-4aef-b215-ead67b884a17 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.920722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809d5b3-84b6-4b5d-a328-851ea8acc262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.921630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809d5b3-84b6-4b5d-a328-851ea8acc262 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.922094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809d5b3-84b6-4b5d-a328-851ea8acc262 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.922217 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809d5b3-84b6-4b5d-a328-851ea8acc262 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/0b0591179ec144f5a90c9a24205b6b47/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.924227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809d5b3-84b6-4b5d-a328-851ea8acc262 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=0b0591179ec144f5a90c9a24205b6b47, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.925644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809d5b3-84b6-4b5d-a328-851ea8acc262 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.002606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:59.019314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 390/765] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:58 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/0b0591179ec144f5a90c9a24205b6b47/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:54:59.020237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef3f11-f4d8-4aef-b215-ead67b884a17 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.022437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588098-cdf7-4f71-850f-61565f6fd7e7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.023741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588098-cdf7-4f71-850f-61565f6fd7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.024224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588098-cdf7-4f71-850f-61565f6fd7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.057484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f6588098-cdf7-4f71-850f-61565f6fd7e7 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:59.059279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f6588098-cdf7-4f71-850f-61565f6fd7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:59.094905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570fbe6-cbe4-44e9-91b8-354d0d672506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.095864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570fbe6-cbe4-44e9-91b8-354d0d672506 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.096295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570fbe6-cbe4-44e9-91b8-354d0d672506 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.096733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570fbe6-cbe4-44e9-91b8-354d0d672506 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.097779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570fbe6-cbe4-44e9-91b8-354d0d672506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:59.099347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570fbe6-cbe4-44e9-91b8-354d0d672506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.100971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570fbe6-cbe4-44e9-91b8-354d0d672506 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.132032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 376/766] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:59.133448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570fbe6-cbe4-44e9-91b8-354d0d672506 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:59.216307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 391/767] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:59.255296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6588098-cdf7-4f71-850f-61565f6fd7e7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:59.293259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570fbe6-cbe4-44e9-91b8-354d0d672506 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.332279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0e18a-6fd0-40d9-919a-990a61526b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.332937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e18a-6fd0-40d9-919a-990a61526b75 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.333219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e18a-6fd0-40d9-919a-990a61526b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.333494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e18a-6fd0-40d9-919a-990a61526b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.334260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:59.335307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e18a-6fd0-40d9-919a-990a61526b75 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=b548998a91fb40519f794668c5c566af) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:59.335777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e18a-6fd0-40d9-919a-990a61526b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.337239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e18a-6fd0-40d9-919a-990a61526b75 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.345501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 377/768] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/role_assignments?user.id=b548998a91fb40519f794668c5c566af&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:59.419714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6588098-cdf7-4f71-850f-61565f6fd7e7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.481843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583893cb-b7a6-47dd-854a-2beda82da567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.482588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583893cb-b7a6-47dd-854a-2beda82da567 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.482869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583893cb-b7a6-47dd-854a-2beda82da567 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.483167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583893cb-b7a6-47dd-854a-2beda82da567 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.483841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583893cb-b7a6-47dd-854a-2beda82da567 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.485313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583893cb-b7a6-47dd-854a-2beda82da567 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-583893cb-b7a6-47dd-854a-2beda82da567 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:59.498501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:59.499537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:54:59.500391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 392/769] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:59.512491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0e18a-6fd0-40d9-919a-990a61526b75 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:59.551501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:59.692388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0e18a-6fd0-40d9-919a-990a61526b75 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.745007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7255588-bab5-4f49-b432-4841bfb36559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.746129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7255588-bab5-4f49-b432-4841bfb36559 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.746414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7255588-bab5-4f49-b432-4841bfb36559 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.746690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7255588-bab5-4f49-b432-4841bfb36559 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.747420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7255588-bab5-4f49-b432-4841bfb36559 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:59.747728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7255588-bab5-4f49-b432-4841bfb36559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.749077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7255588-bab5-4f49-b432-4841bfb36559 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.759300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 378/770] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:59.764978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583893cb-b7a6-47dd-854a-2beda82da567 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:59.856152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e0bf-80b4-47c4-bed2-95cd2c134653 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.856496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e0bf-80b4-47c4-bed2-95cd2c134653 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.856712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e0bf-80b4-47c4-bed2-95cd2c134653 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.858267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 379/771] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:59.863601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587095b-ad82-4bbb-95ba-1d5e0a7ddaff None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.863886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587095b-ad82-4bbb-95ba-1d5e0a7ddaff None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.864165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587095b-ad82-4bbb-95ba-1d5e0a7ddaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.896211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a587095b-ad82-4bbb-95ba-1d5e0a7ddaff None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:59.897412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a587095b-ad82-4bbb-95ba-1d5e0a7ddaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:59.906447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583893cb-b7a6-47dd-854a-2beda82da567 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.915132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:59.950354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b4c58-943f-4b1e-a613-de0266f71f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.951028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b4c58-943f-4b1e-a613-de0266f71f27 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.951331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b4c58-943f-4b1e-a613-de0266f71f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.951606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b4c58-943f-4b1e-a613-de0266f71f27 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.952318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b4c58-943f-4b1e-a613-de0266f71f27 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:59.952622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b4c58-943f-4b1e-a613-de0266f71f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.953980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b4c58-943f-4b1e-a613-de0266f71f27 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.971945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 393/772] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:59.973675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b4c58-943f-4b1e-a613-de0266f71f27 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.014353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 380/773] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:00.037650 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587095b-ad82-4bbb-95ba-1d5e0a7ddaff None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.046796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.129236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b4c58-943f-4b1e-a613-de0266f71f27 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.146822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587095b-ad82-4bbb-95ba-1d5e0a7ddaff None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.183525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e258d-e28a-40e9-a78e-ff1e5b356035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.184672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e258d-e28a-40e9-a78e-ff1e5b356035 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.185238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e258d-e28a-40e9-a78e-ff1e5b356035 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.185715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e258d-e28a-40e9-a78e-ff1e5b356035 None admin] PATH_INFO: `/v3/services/network` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.186586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e258d-e28a-40e9-a78e-ff1e5b356035 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.188280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e258d-e28a-40e9-a78e-ff1e5b356035 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.192661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485460-4da1-494a-910b-9fea2784a9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.193329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485460-4da1-494a-910b-9fea2784a9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.193604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485460-4da1-494a-910b-9fea2784a9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.193873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485460-4da1-494a-910b-9fea2784a9b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.194663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485460-4da1-494a-910b-9fea2784a9b0 None admin] RBAC: Adding query filter params (interface=public, service_id=689091d8b3db499c8f0c319ea677237b, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:00.194969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485460-4da1-494a-910b-9fea2784a9b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.196334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485460-4da1-494a-910b-9fea2784a9b0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-324e258d-e28a-40e9-a78e-ff1e5b356035 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:00.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:00.203153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:55:00.203998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:00.206825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 381/774] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:00.211065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 394/775] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/endpoints?service_id=689091d8b3db499c8f0c319ea677237b&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:00.213045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e258d-e28a-40e9-a78e-ff1e5b356035 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.217032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485460-4da1-494a-910b-9fea2784a9b0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.318023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.349586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.410471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e258d-e28a-40e9-a78e-ff1e5b356035 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.429681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485460-4da1-494a-910b-9fea2784a9b0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.453717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa82f8-e5c4-413d-9822-f397b27a8c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.454388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa82f8-e5c4-413d-9822-f397b27a8c4d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.454665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa82f8-e5c4-413d-9822-f397b27a8c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.454936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa82f8-e5c4-413d-9822-f397b27a8c4d None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.455666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa82f8-e5c4-413d-9822-f397b27a8c4d None admin] RBAC: Adding query filter params (name=network) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:00.455966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa82f8-e5c4-413d-9822-f397b27a8c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.457323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa82f8-e5c4-413d-9822-f397b27a8c4d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.472629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 382/776] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:00.478122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa82f8-e5c4-413d-9822-f397b27a8c4d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.502562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc275d-5e02-4bdc-8f82-980a2a005ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.503249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc275d-5e02-4bdc-8f82-980a2a005ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.503529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc275d-5e02-4bdc-8f82-980a2a005ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.503802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc275d-5e02-4bdc-8f82-980a2a005ca6 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.504482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc275d-5e02-4bdc-8f82-980a2a005ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.505835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc275d-5e02-4bdc-8f82-980a2a005ca6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.526084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 395/777] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/services => generated 772 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:00.603345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa82f8-e5c4-413d-9822-f397b27a8c4d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.642443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e093a3-724f-4ff4-a64f-1b96c00b7229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.643166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e093a3-724f-4ff4-a64f-1b96c00b7229 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.643452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e093a3-724f-4ff4-a64f-1b96c00b7229 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.643727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e093a3-724f-4ff4-a64f-1b96c00b7229 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.644464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e093a3-724f-4ff4-a64f-1b96c00b7229 None admin] RBAC: Adding query filter params (type=network) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:00.644777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e093a3-724f-4ff4-a64f-1b96c00b7229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.646184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e093a3-724f-4ff4-a64f-1b96c00b7229 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.648112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.656597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 383/778] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:00.662106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc275d-5e02-4bdc-8f82-980a2a005ca6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.674967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d337-82e5-4db1-ba0a-9fe2a253de80 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.675328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d337-82e5-4db1-ba0a-9fe2a253de80 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.675549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d337-82e5-4db1-ba0a-9fe2a253de80 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.678413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 384/779] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:00.682881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc413ba3-0fc4-4a8e-9782-2f8d8b6cfb45 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.683246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc413ba3-0fc4-4a8e-9782-2f8d8b6cfb45 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.683471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc413ba3-0fc4-4a8e-9782-2f8d8b6cfb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.713030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cc413ba3-0fc4-4a8e-9782-2f8d8b6cfb45 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:00.714851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cc413ba3-0fc4-4a8e-9782-2f8d8b6cfb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:00.825488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc275d-5e02-4bdc-8f82-980a2a005ca6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.839468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 385/780] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:00.851466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.859890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc413ba3-0fc4-4a8e-9782-2f8d8b6cfb45 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.872744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172f2fb-2b7d-449f-bcae-55e89927be13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.873856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f2fb-2b7d-449f-bcae-55e89927be13 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.874443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f2fb-2b7d-449f-bcae-55e89927be13 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.874975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f2fb-2b7d-449f-bcae-55e89927be13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.875995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f2fb-2b7d-449f-bcae-55e89927be13 None admin] RBAC: Adding query filter params (interface=public, service_id=a13fa18603f7486eb403d9af9d8f64bd, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:00.876508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f2fb-2b7d-449f-bcae-55e89927be13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.878161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f2fb-2b7d-449f-bcae-55e89927be13 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.884268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 396/781] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/endpoints?service_id=a13fa18603f7486eb403d9af9d8f64bd&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:00.890740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172f2fb-2b7d-449f-bcae-55e89927be13 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.034089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc413ba3-0fc4-4a8e-9782-2f8d8b6cfb45 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.064030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172f2fb-2b7d-449f-bcae-55e89927be13 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.073868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.096391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd9ec-4382-4ac3-bfa1-9867291e083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.096391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd9ec-4382-4ac3-bfa1-9867291e083a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.096391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd9ec-4382-4ac3-bfa1-9867291e083a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.096391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd9ec-4382-4ac3-bfa1-9867291e083a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.116070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbd9ec-4382-4ac3-bfa1-9867291e083a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2ccbd9ec-4382-4ac3-bfa1-9867291e083a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:01.124586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:01.125541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:01.126389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 386/782] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:01.133173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd9ec-4382-4ac3-bfa1-9867291e083a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.140399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe58d9-b7c0-40a0-ac16-bba7a596bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.141083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe58d9-b7c0-40a0-ac16-bba7a596bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.141360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe58d9-b7c0-40a0-ac16-bba7a596bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.141627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe58d9-b7c0-40a0-ac16-bba7a596bbd5 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.142310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe58d9-b7c0-40a0-ac16-bba7a596bbd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.143711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe58d9-b7c0-40a0-ac16-bba7a596bbd5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.152281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 397/783] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/services => generated 772 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:01.239656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd9ec-4382-4ac3-bfa1-9867291e083a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.299362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb2d9b-2a9f-441d-9be8-ac2884c0854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.300473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb2d9b-2a9f-441d-9be8-ac2884c0854c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.300982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb2d9b-2a9f-441d-9be8-ac2884c0854c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.301454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb2d9b-2a9f-441d-9be8-ac2884c0854c None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.302424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb2d9b-2a9f-441d-9be8-ac2884c0854c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:01.302945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb2d9b-2a9f-441d-9be8-ac2884c0854c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.304778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb2d9b-2a9f-441d-9be8-ac2884c0854c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.315713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 387/784] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:01.322148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe58d9-b7c0-40a0-ac16-bba7a596bbd5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.363438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.436823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe58d9-b7c0-40a0-ac16-bba7a596bbd5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.472941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aee534-61a0-4c0c-8234-9fa8253fbdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.474089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aee534-61a0-4c0c-8234-9fa8253fbdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.474599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aee534-61a0-4c0c-8234-9fa8253fbdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.475068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aee534-61a0-4c0c-8234-9fa8253fbdc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.487021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aee534-61a0-4c0c-8234-9fa8253fbdc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.488758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aee534-61a0-4c0c-8234-9fa8253fbdc8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-57aee534-61a0-4c0c-8234-9fa8253fbdc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:01.508519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:01.509456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:01.510353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:01.510353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:01.510353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:01.510353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:01.512682 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 398/785] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:01.518477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb2d9b-2a9f-441d-9be8-ac2884c0854c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.572594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.639004 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb2d9b-2a9f-441d-9be8-ac2884c0854c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.681668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e2159-7cad-48be-9a50-ac1e470229c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.682337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e2159-7cad-48be-9a50-ac1e470229c4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.683197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e2159-7cad-48be-9a50-ac1e470229c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.683470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e2159-7cad-48be-9a50-ac1e470229c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.684189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e2159-7cad-48be-9a50-ac1e470229c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:01.684505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e2159-7cad-48be-9a50-ac1e470229c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.685854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e2159-7cad-48be-9a50-ac1e470229c4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.705287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 388/786] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:01.711044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aee534-61a0-4c0c-8234-9fa8253fbdc8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.716831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40701681-df20-4a9a-9775-5f23c72d3214 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.717121 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40701681-df20-4a9a-9775-5f23c72d3214 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.717388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40701681-df20-4a9a-9775-5f23c72d3214 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.719232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 389/787] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:01.724331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc748e6-c9d1-42b9-8fbe-099ef29c9b5e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.724610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc748e6-c9d1-42b9-8fbe-099ef29c9b5e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.724881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc748e6-c9d1-42b9-8fbe-099ef29c9b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.742392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1dc748e6-c9d1-42b9-8fbe-099ef29c9b5e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:01.743612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1dc748e6-c9d1-42b9-8fbe-099ef29c9b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:01.879162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 390/788] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:01.892731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.908094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aee534-61a0-4c0c-8234-9fa8253fbdc8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.948706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646ff60-a28a-4480-a8fa-1d994587572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.949501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646ff60-a28a-4480-a8fa-1d994587572d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.949776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646ff60-a28a-4480-a8fa-1d994587572d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.950046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646ff60-a28a-4480-a8fa-1d994587572d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.955726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc748e6-c9d1-42b9-8fbe-099ef29c9b5e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.959756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646ff60-a28a-4480-a8fa-1d994587572d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.962149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646ff60-a28a-4480-a8fa-1d994587572d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3646ff60-a28a-4480-a8fa-1d994587572d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:01.978910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:01.980494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:01.981442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 399/789] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:01.989462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646ff60-a28a-4480-a8fa-1d994587572d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.036682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.105892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646ff60-a28a-4480-a8fa-1d994587572d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.143898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9548dbb-af8b-4d60-ab78-b0679213c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.144937 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548dbb-af8b-4d60-ab78-b0679213c6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.145419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548dbb-af8b-4d60-ab78-b0679213c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.145890 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548dbb-af8b-4d60-ab78-b0679213c6f8 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.145996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc748e6-c9d1-42b9-8fbe-099ef29c9b5e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.147041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9548dbb-af8b-4d60-ab78-b0679213c6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:02.147600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9548dbb-af8b-4d60-ab78-b0679213c6f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.149240 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9548dbb-af8b-4d60-ab78-b0679213c6f8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.168545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 400/790] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:02.170233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352cf71-d807-4fae-add9-9630fb015cd3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.170741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352cf71-d807-4fae-add9-9630fb015cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.171335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352cf71-d807-4fae-add9-9630fb015cd3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.173017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 401/791] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:02.173910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352cf71-d807-4fae-add9-9630fb015cd3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.182764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.192637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115c874-1909-4637-8887-8abdeb454ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.198574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115c874-1909-4637-8887-8abdeb454ceb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.198574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115c874-1909-4637-8887-8abdeb454ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.198574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115c874-1909-4637-8887-8abdeb454ceb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.206335 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115c874-1909-4637-8887-8abdeb454ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d115c874-1909-4637-8887-8abdeb454ceb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:02.214845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:02.215810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:02.216643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:02.219721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 391/792] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:02.222293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b2ea-6269-4905-a09e-d690f1053894 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.222765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b2ea-6269-4905-a09e-d690f1053894 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.223282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b2ea-6269-4905-a09e-d690f1053894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.241191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bb92b2ea-6269-4905-a09e-d690f1053894 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:02.242864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bb92b2ea-6269-4905-a09e-d690f1053894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:02.294366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352cf71-d807-4fae-add9-9630fb015cd3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.324865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 392/793] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:02.326220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b2ea-6269-4905-a09e-d690f1053894 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.330871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9468f-2f7d-47e9-a0c3-5f716243d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.331770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9468f-2f7d-47e9-a0c3-5f716243d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.332120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9468f-2f7d-47e9-a0c3-5f716243d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.332486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9468f-2f7d-47e9-a0c3-5f716243d1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.344006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9468f-2f7d-47e9-a0c3-5f716243d1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.345742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9468f-2f7d-47e9-a0c3-5f716243d1d3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-61a9468f-2f7d-47e9-a0c3-5f716243d1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:02.366950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:02.367889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:02.368814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:02.368814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:02.368814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:02.368814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:02.368814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 402/794] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:02.368814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9468f-2f7d-47e9-a0c3-5f716243d1d3 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.379394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.427662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.453548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b2ea-6269-4905-a09e-d690f1053894 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.469855 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9468f-2f7d-47e9-a0c3-5f716243d1d3 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.490605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa9e46-ab09-437b-a8c3-564333ad3ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.491616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa9e46-ab09-437b-a8c3-564333ad3ebc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.492107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa9e46-ab09-437b-a8c3-564333ad3ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.492600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa9e46-ab09-437b-a8c3-564333ad3ebc None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.493544 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa9e46-ab09-437b-a8c3-564333ad3ebc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:02.494066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa9e46-ab09-437b-a8c3-564333ad3ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.496584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa9e46-ab09-437b-a8c3-564333ad3ebc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.505970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 393/795] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:02.506186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16b4bd-48d4-427b-898d-7a9bc63f6878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.507081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16b4bd-48d4-427b-898d-7a9bc63f6878 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.507407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16b4bd-48d4-427b-898d-7a9bc63f6878 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.507648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa9e46-ab09-437b-a8c3-564333ad3ebc None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.507750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16b4bd-48d4-427b-898d-7a9bc63f6878 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.519125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16b4bd-48d4-427b-898d-7a9bc63f6878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-db16b4bd-48d4-427b-898d-7a9bc63f6878 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:02.527444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:02.528373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:55:02.529201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:02.533467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 403/796] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:02.534315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16b4bd-48d4-427b-898d-7a9bc63f6878 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.607172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.617332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa9e46-ab09-437b-a8c3-564333ad3ebc None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.636091 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16b4bd-48d4-427b-898d-7a9bc63f6878 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.653107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a17b4e-5ccb-4bae-a97e-2a749baf4d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.654073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17b4e-5ccb-4bae-a97e-2a749baf4d17 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.654538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17b4e-5ccb-4bae-a97e-2a749baf4d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.655008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17b4e-5ccb-4bae-a97e-2a749baf4d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.655979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a17b4e-5ccb-4bae-a97e-2a749baf4d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:02.656480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a17b4e-5ccb-4bae-a97e-2a749baf4d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.658026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a17b4e-5ccb-4bae-a97e-2a749baf4d17 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.663518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.672235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55a1f0-eb50-4cbb-bbee-aa7e662eb28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.673195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a1f0-eb50-4cbb-bbee-aa7e662eb28d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.673601 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a1f0-eb50-4cbb-bbee-aa7e662eb28d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.673792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 394/797] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:02.673892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a1f0-eb50-4cbb-bbee-aa7e662eb28d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.674911 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a17b4e-5ccb-4bae-a97e-2a749baf4d17 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.686692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55a1f0-eb50-4cbb-bbee-aa7e662eb28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.688430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55a1f0-eb50-4cbb-bbee-aa7e662eb28d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5d55a1f0-eb50-4cbb-bbee-aa7e662eb28d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:02.706542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:02.707515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:02.708437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:02.708437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:02.708437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:02.708437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:02.708437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 404/798] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:02.709570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55a1f0-eb50-4cbb-bbee-aa7e662eb28d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.785791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a17b4e-5ccb-4bae-a97e-2a749baf4d17 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.815488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55a1f0-eb50-4cbb-bbee-aa7e662eb28d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.822491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a373a-89e0-4b05-b9d7-e14234cf5451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.823999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a373a-89e0-4b05-b9d7-e14234cf5451 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.824523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a373a-89e0-4b05-b9d7-e14234cf5451 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.825069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a373a-89e0-4b05-b9d7-e14234cf5451 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.826019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a373a-89e0-4b05-b9d7-e14234cf5451 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:02.826527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a373a-89e0-4b05-b9d7-e14234cf5451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.828136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a373a-89e0-4b05-b9d7-e14234cf5451 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.837006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 395/799] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:02.838081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a373a-89e0-4b05-b9d7-e14234cf5451 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.855003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.856855 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc80d2b-7aad-420e-a087-2077d9978447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.857738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc80d2b-7aad-420e-a087-2077d9978447 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.858117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc80d2b-7aad-420e-a087-2077d9978447 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.858403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc80d2b-7aad-420e-a087-2077d9978447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.866273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc80d2b-7aad-420e-a087-2077d9978447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.867856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc80d2b-7aad-420e-a087-2077d9978447 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2cc80d2b-7aad-420e-a087-2077d9978447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:02.883598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:02.886158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 405/800] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:02.887066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc80d2b-7aad-420e-a087-2077d9978447 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.951587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.953592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a373a-89e0-4b05-b9d7-e14234cf5451 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.991914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7f134-75ac-49e6-91d3-49fc886076ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.992939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f134-75ac-49e6-91d3-49fc886076ae None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.993447 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f134-75ac-49e6-91d3-49fc886076ae None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.993985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f134-75ac-49e6-91d3-49fc886076ae None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.994340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc80d2b-7aad-420e-a087-2077d9978447 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.995753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7f134-75ac-49e6-91d3-49fc886076ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:02.996266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7f134-75ac-49e6-91d3-49fc886076ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.997820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7f134-75ac-49e6-91d3-49fc886076ae None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.010736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 396/801] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:03.011841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7f134-75ac-49e6-91d3-49fc886076ae None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.029589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce103f-ef03-4390-ac7e-0352cb594a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.030387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce103f-ef03-4390-ac7e-0352cb594a9e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.030667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce103f-ef03-4390-ac7e-0352cb594a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.030940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce103f-ef03-4390-ac7e-0352cb594a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.041453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce103f-ef03-4390-ac7e-0352cb594a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:03.043656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce103f-ef03-4390-ac7e-0352cb594a9e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-51ce103f-ef03-4390-ac7e-0352cb594a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:03.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:03.062992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:03.063927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:03.063927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:03.063927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:03.063927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:03.067431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 406/802] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:03.068256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce103f-ef03-4390-ac7e-0352cb594a9e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.094249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:03.121327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7f134-75ac-49e6-91d3-49fc886076ae None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:03.155574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:03.158194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1383-feec-40e1-8abc-9434669710e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.159115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1383-feec-40e1-8abc-9434669710e7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.159625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1383-feec-40e1-8abc-9434669710e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.160105 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1383-feec-40e1-8abc-9434669710e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.161108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d1383-feec-40e1-8abc-9434669710e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:03.161639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d1383-feec-40e1-8abc-9434669710e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:03.163284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d1383-feec-40e1-8abc-9434669710e7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.171677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce103f-ef03-4390-ac7e-0352cb594a9e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:03.176870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 397/803] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:03.177960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1383-feec-40e1-8abc-9434669710e7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.211915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eee6b0-3802-4c16-9dc9-a3c3582d43f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.212638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eee6b0-3802-4c16-9dc9-a3c3582d43f6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.212918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eee6b0-3802-4c16-9dc9-a3c3582d43f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.213190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eee6b0-3802-4c16-9dc9-a3c3582d43f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.225502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eee6b0-3802-4c16-9dc9-a3c3582d43f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:03.227859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eee6b0-3802-4c16-9dc9-a3c3582d43f6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-98eee6b0-3802-4c16-9dc9-a3c3582d43f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:03.249784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:03.250751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:03.251730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:03.259109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 407/804] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:03.260514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eee6b0-3802-4c16-9dc9-a3c3582d43f6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.305324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1383-feec-40e1-8abc-9434669710e7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:03.343579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f83a60-af02-47fb-8a11-d97f59098491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.344237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f83a60-af02-47fb-8a11-d97f59098491 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.344518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f83a60-af02-47fb-8a11-d97f59098491 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.344785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f83a60-af02-47fb-8a11-d97f59098491 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.345607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f83a60-af02-47fb-8a11-d97f59098491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:03.345903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f83a60-af02-47fb-8a11-d97f59098491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:03.347401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f83a60-af02-47fb-8a11-d97f59098491 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.348984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:03.361374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 398/805] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:03.363313 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f83a60-af02-47fb-8a11-d97f59098491 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.381301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eee6b0-3802-4c16-9dc9-a3c3582d43f6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:03.419938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e305f-615c-4d79-b3b1-8cc613a75bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.420822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e305f-615c-4d79-b3b1-8cc613a75bcd None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.421101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e305f-615c-4d79-b3b1-8cc613a75bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.421373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e305f-615c-4d79-b3b1-8cc613a75bcd None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/ffbe700a0ebc48b5953a600400ecfed5/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.423409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e305f-615c-4d79-b3b1-8cc613a75bcd None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=ffbe700a0ebc48b5953a600400ecfed5, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:03.424838 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e305f-615c-4d79-b3b1-8cc613a75bcd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.466296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f83a60-af02-47fb-8a11-d97f59098491 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:03.500899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070a9c3-0ba2-4d0f-a1f6-7e994c34fa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.501563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070a9c3-0ba2-4d0f-a1f6-7e994c34fa51 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.501840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070a9c3-0ba2-4d0f-a1f6-7e994c34fa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.502111 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070a9c3-0ba2-4d0f-a1f6-7e994c34fa51 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.502933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070a9c3-0ba2-4d0f-a1f6-7e994c34fa51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:03.503266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070a9c3-0ba2-4d0f-a1f6-7e994c34fa51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:03.504678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070a9c3-0ba2-4d0f-a1f6-7e994c34fa51 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.511617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 408/806] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:03 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/ffbe700a0ebc48b5953a600400ecfed5/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:55:03.514194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4a04d-cd3e-45bd-a617-1603809ff0f9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.514490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4a04d-cd3e-45bd-a617-1603809ff0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.514772 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4a04d-cd3e-45bd-a617-1603809ff0f9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.516600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 409/807] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:03.517160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4a04d-cd3e-45bd-a617-1603809ff0f9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.530346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:03.545088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 399/808] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:03.546964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b227-6424-4ce5-9ac4-8dc01ea50a78 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.547538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b227-6424-4ce5-9ac4-8dc01ea50a78 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.547994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b227-6424-4ce5-9ac4-8dc01ea50a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.567131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fa84b227-6424-4ce5-9ac4-8dc01ea50a78 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:03.568776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa84b227-6424-4ce5-9ac4-8dc01ea50a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:03.632470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:03.654716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4a04d-cd3e-45bd-a617-1603809ff0f9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:03.659241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 400/809] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:03.660375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84b227-6424-4ce5-9ac4-8dc01ea50a78 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.707140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e0289-fc72-4a84-9931-0baa4ed3e8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.708907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e0289-fc72-4a84-9931-0baa4ed3e8ef None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.709371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e0289-fc72-4a84-9931-0baa4ed3e8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.709868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e0289-fc72-4a84-9931-0baa4ed3e8ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.721947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e0289-fc72-4a84-9931-0baa4ed3e8ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:03.724211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e0289-fc72-4a84-9931-0baa4ed3e8ef None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d29e0289-fc72-4a84-9931-0baa4ed3e8ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:03.745153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:03.746215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 410/810] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:03.747633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e0289-fc72-4a84-9931-0baa4ed3e8ef None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.798340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84b227-6424-4ce5-9ac4-8dc01ea50a78 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:03.832972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:03.834661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b221147-98eb-4ec3-bd2b-014c416ef6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.835606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b221147-98eb-4ec3-bd2b-014c416ef6ca None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.836092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b221147-98eb-4ec3-bd2b-014c416ef6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.836649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b221147-98eb-4ec3-bd2b-014c416ef6ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.886094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e0289-fc72-4a84-9931-0baa4ed3e8ef None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:03.895623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:03.916051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b221147-98eb-4ec3-bd2b-014c416ef6ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:03.917840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b221147-98eb-4ec3-bd2b-014c416ef6ca None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.926282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3988fbb-073b-49c9-832b-68527c18460b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.927270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988fbb-073b-49c9-832b-68527c18460b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.927554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988fbb-073b-49c9-832b-68527c18460b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.927823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988fbb-073b-49c9-832b-68527c18460b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.928827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3988fbb-073b-49c9-832b-68527c18460b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:03.930479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3988fbb-073b-49c9-832b-68527c18460b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a3988fbb-073b-49c9-832b-68527c18460b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:03.943303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:03.944231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:03.945050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 411/811] 10.222.0.13 () {56 vars in 1129 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:03.945884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3988fbb-073b-49c9-832b-68527c18460b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.027380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 401/812] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:04.028585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6a579-7d81-4599-b7bf-9644b04b8a15 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.028870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6a579-7d81-4599-b7bf-9644b04b8a15 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.029140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6a579-7d81-4599-b7bf-9644b04b8a15 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.030634 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 402/813] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:04.035143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6a579-7d81-4599-b7bf-9644b04b8a15 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.056812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3988fbb-073b-49c9-832b-68527c18460b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.082819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.091894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a619d1b-2407-4c53-9532-52263f8ca48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.093449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a619d1b-2407-4c53-9532-52263f8ca48a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.094390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a619d1b-2407-4c53-9532-52263f8ca48a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.094856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a619d1b-2407-4c53-9532-52263f8ca48a None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.096192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a619d1b-2407-4c53-9532-52263f8ca48a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:04.096762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a619d1b-2407-4c53-9532-52263f8ca48a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.098227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a619d1b-2407-4c53-9532-52263f8ca48a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.120986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 412/814] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:04.120986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a619d1b-2407-4c53-9532-52263f8ca48a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.137338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.157519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6a579-7d81-4599-b7bf-9644b04b8a15 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.194002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd74ea-18af-42fc-a69f-2d02ceedc963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.194663 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd74ea-18af-42fc-a69f-2d02ceedc963 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.195056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd74ea-18af-42fc-a69f-2d02ceedc963 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.195349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd74ea-18af-42fc-a69f-2d02ceedc963 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.196039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd74ea-18af-42fc-a69f-2d02ceedc963 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:04.196338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd74ea-18af-42fc-a69f-2d02ceedc963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.198482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd74ea-18af-42fc-a69f-2d02ceedc963 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.207621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 403/815] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:04.207621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed569a-d054-4a85-a5e6-a57ef1ec57fc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.207621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed569a-d054-4a85-a5e6-a57ef1ec57fc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.207621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed569a-d054-4a85-a5e6-a57ef1ec57fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.223340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-86ed569a-d054-4a85-a5e6-a57ef1ec57fc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:04.224190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a619d1b-2407-4c53-9532-52263f8ca48a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.224502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-86ed569a-d054-4a85-a5e6-a57ef1ec57fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:04.266864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612080f5-0fc3-46a7-9b66-97d1beba12df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.267707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612080f5-0fc3-46a7-9b66-97d1beba12df None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.267994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612080f5-0fc3-46a7-9b66-97d1beba12df None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.268274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612080f5-0fc3-46a7-9b66-97d1beba12df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.278793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612080f5-0fc3-46a7-9b66-97d1beba12df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.280201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612080f5-0fc3-46a7-9b66-97d1beba12df None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.296847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 404/816] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-612080f5-0fc3-46a7-9b66-97d1beba12df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:04.299155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:04.300062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:04.300960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:04.300960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:04.300960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:04.300960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:04.304027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed569a-d054-4a85-a5e6-a57ef1ec57fc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.304770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 413/817] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:04.305564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612080f5-0fc3-46a7-9b66-97d1beba12df None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.344468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.391196 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.414835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed569a-d054-4a85-a5e6-a57ef1ec57fc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.415000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612080f5-0fc3-46a7-9b66-97d1beba12df None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.449755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdb521-0bb4-42ac-a1dd-bf1dd0a0e499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.450275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1f7b7-47d9-47bc-b5a3-e35de32985f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.450425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdb521-0bb4-42ac-a1dd-bf1dd0a0e499 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.450681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdb521-0bb4-42ac-a1dd-bf1dd0a0e499 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.450953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdb521-0bb4-42ac-a1dd-bf1dd0a0e499 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.451047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1f7b7-47d9-47bc-b5a3-e35de32985f5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.451380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1f7b7-47d9-47bc-b5a3-e35de32985f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.451655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1f7b7-47d9-47bc-b5a3-e35de32985f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.451748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdb521-0bb4-42ac-a1dd-bf1dd0a0e499 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:04.451970 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdb521-0bb4-42ac-a1dd-bf1dd0a0e499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.453338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdb521-0bb4-42ac-a1dd-bf1dd0a0e499 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.458487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 414/818] 10.222.0.13 () {56 vars in 1124 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:04.459079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdb521-0bb4-42ac-a1dd-bf1dd0a0e499 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.466934 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1f7b7-47d9-47bc-b5a3-e35de32985f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.468676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1f7b7-47d9-47bc-b5a3-e35de32985f5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-daf1f7b7-47d9-47bc-b5a3-e35de32985f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:04.486244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:04.487145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:04.488027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:04.488027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:04.488027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:04.488027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:04.488027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 405/819] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:04.488312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1f7b7-47d9-47bc-b5a3-e35de32985f5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.568604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.573321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdb521-0bb4-42ac-a1dd-bf1dd0a0e499 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.592828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1f7b7-47d9-47bc-b5a3-e35de32985f5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.607747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2a8e3-1f30-4e84-8936-959b29c3a54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.608416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2a8e3-1f30-4e84-8936-959b29c3a54d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.608699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2a8e3-1f30-4e84-8936-959b29c3a54d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.608976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2a8e3-1f30-4e84-8936-959b29c3a54d None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.609776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2a8e3-1f30-4e84-8936-959b29c3a54d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:04.610638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2a8e3-1f30-4e84-8936-959b29c3a54d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.612551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2a8e3-1f30-4e84-8936-959b29c3a54d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.620190 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.629598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 415/820] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:04.629598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2a8e3-1f30-4e84-8936-959b29c3a54d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.635868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4f99-ae68-47c3-85b2-8c7d0fbd3940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.635868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4f99-ae68-47c3-85b2-8c7d0fbd3940 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.635868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4f99-ae68-47c3-85b2-8c7d0fbd3940 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.635868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4f99-ae68-47c3-85b2-8c7d0fbd3940 None admin] PATH_INFO: `/v3/services/network` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.636487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd4f99-ae68-47c3-85b2-8c7d0fbd3940 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.636487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd4f99-ae68-47c3-85b2-8c7d0fbd3940 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b1dd4f99-ae68-47c3-85b2-8c7d0fbd3940 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:04.648670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:04.649944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:55:04.650818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:04.655545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 406/821] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:04.656383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4f99-ae68-47c3-85b2-8c7d0fbd3940 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.746293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2a8e3-1f30-4e84-8936-959b29c3a54d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.764524 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4f99-ae68-47c3-85b2-8c7d0fbd3940 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.783548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a047e-4993-4eb8-8685-651fa59a6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.784211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a047e-4993-4eb8-8685-651fa59a6c35 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.784495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a047e-4993-4eb8-8685-651fa59a6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.784882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a047e-4993-4eb8-8685-651fa59a6c35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.785616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a047e-4993-4eb8-8685-651fa59a6c35 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.786971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a047e-4993-4eb8-8685-651fa59a6c35 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.798514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eeef3-49a0-45b7-877c-099370e9f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.799217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eeef3-49a0-45b7-877c-099370e9f0eb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.799500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eeef3-49a0-45b7-877c-099370e9f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.799776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eeef3-49a0-45b7-877c-099370e9f0eb None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.800502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eeef3-49a0-45b7-877c-099370e9f0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:04.800837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eeef3-49a0-45b7-877c-099370e9f0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.802185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eeef3-49a0-45b7-877c-099370e9f0eb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.814792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 407/822] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:04.815458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eeef3-49a0-45b7-877c-099370e9f0eb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.867711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.897980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 416/823] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:04.899034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a047e-4993-4eb8-8685-651fa59a6c35 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.928498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eeef3-49a0-45b7-877c-099370e9f0eb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.929807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.984697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42141034-d461-4047-847b-196f362f383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.986295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42141034-d461-4047-847b-196f362f383e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.986995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42141034-d461-4047-847b-196f362f383e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.987457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42141034-d461-4047-847b-196f362f383e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.998087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42141034-d461-4047-847b-196f362f383e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.000137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42141034-d461-4047-847b-196f362f383e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-42141034-d461-4047-847b-196f362f383e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:05.019500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:05.020631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:05.021727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:05.021727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:05.021727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:05.021727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:05.021727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:05.021727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:05.021727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:05.021727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:05.024781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 408/824] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:05.026100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42141034-d461-4047-847b-196f362f383e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.056354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a047e-4993-4eb8-8685-651fa59a6c35 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.112415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c7eee-6dcf-44b2-a6dc-402c6c0ea7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.113118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c7eee-6dcf-44b2-a6dc-402c6c0ea7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.113403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c7eee-6dcf-44b2-a6dc-402c6c0ea7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.113676 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c7eee-6dcf-44b2-a6dc-402c6c0ea7d4 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.114412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c7eee-6dcf-44b2-a6dc-402c6c0ea7d4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.114716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c7eee-6dcf-44b2-a6dc-402c6c0ea7d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.119195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c7eee-6dcf-44b2-a6dc-402c6c0ea7d4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.124260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 417/825] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.124922 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c7eee-6dcf-44b2-a6dc-402c6c0ea7d4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.150222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42141034-d461-4047-847b-196f362f383e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.161177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.193368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9900bd-a329-47b9-a816-b778fb0a6ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.194270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9900bd-a329-47b9-a816-b778fb0a6ade None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.194551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9900bd-a329-47b9-a816-b778fb0a6ade None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.194924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9900bd-a329-47b9-a816-b778fb0a6ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.202381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9900bd-a329-47b9-a816-b778fb0a6ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.203907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9900bd-a329-47b9-a816-b778fb0a6ade None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-bd9900bd-a329-47b9-a816-b778fb0a6ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:05.220021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:05.220984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:05.221904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:05.221904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:05.221904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:05.221904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:05.221904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:05.221904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:05.221904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:05.221904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:05.226037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 409/826] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:05.226852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9900bd-a329-47b9-a816-b778fb0a6ade None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.229537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.258791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c7eee-6dcf-44b2-a6dc-402c6c0ea7d4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.298781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ac49-58f9-4a20-89f0-e45293ca7823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.299625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ac49-58f9-4a20-89f0-e45293ca7823 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.299981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ac49-58f9-4a20-89f0-e45293ca7823 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.300326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ac49-58f9-4a20-89f0-e45293ca7823 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.301197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ac49-58f9-4a20-89f0-e45293ca7823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.301566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ac49-58f9-4a20-89f0-e45293ca7823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.303081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ac49-58f9-4a20-89f0-e45293ca7823 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.317040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 418/827] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.318006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ac49-58f9-4a20-89f0-e45293ca7823 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.358495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9900bd-a329-47b9-a816-b778fb0a6ade None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.404866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed78e2-2594-49ae-9a69-39cdfb30057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.405718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed78e2-2594-49ae-9a69-39cdfb30057f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.405993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed78e2-2594-49ae-9a69-39cdfb30057f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.406262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed78e2-2594-49ae-9a69-39cdfb30057f None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.407243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed78e2-2594-49ae-9a69-39cdfb30057f None admin] RBAC: Adding query filter params (type=network) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.407551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed78e2-2594-49ae-9a69-39cdfb30057f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.409676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed78e2-2594-49ae-9a69-39cdfb30057f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.417055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 410/828] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.417864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed78e2-2594-49ae-9a69-39cdfb30057f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.433232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ac49-58f9-4a20-89f0-e45293ca7823 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.455953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.480947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbbb17-6e1e-46e8-b154-3569090cc763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.481610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbbb17-6e1e-46e8-b154-3569090cc763 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.481935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbbb17-6e1e-46e8-b154-3569090cc763 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.482213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbbb17-6e1e-46e8-b154-3569090cc763 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.482996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbbb17-6e1e-46e8-b154-3569090cc763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.483331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbbb17-6e1e-46e8-b154-3569090cc763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.485564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbbb17-6e1e-46e8-b154-3569090cc763 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.500499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.509602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 419/829] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.510739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbbb17-6e1e-46e8-b154-3569090cc763 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.546971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed78e2-2594-49ae-9a69-39cdfb30057f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.587918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86ca6e-d53f-41f5-a326-b450f59a7278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.589258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86ca6e-d53f-41f5-a326-b450f59a7278 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.589641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86ca6e-d53f-41f5-a326-b450f59a7278 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.590016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86ca6e-d53f-41f5-a326-b450f59a7278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.591071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86ca6e-d53f-41f5-a326-b450f59a7278 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=0b0591179ec144f5a90c9a24205b6b47) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.591499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86ca6e-d53f-41f5-a326-b450f59a7278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.593379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86ca6e-d53f-41f5-a326-b450f59a7278 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.600207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 411/830] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/role_assignments?user.id=0b0591179ec144f5a90c9a24205b6b47&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.601171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86ca6e-d53f-41f5-a326-b450f59a7278 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.635950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbbb17-6e1e-46e8-b154-3569090cc763 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.682651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bae0d-3444-4563-999a-75c24d4e2f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.683537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bae0d-3444-4563-999a-75c24d4e2f6f None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.684654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bae0d-3444-4563-999a-75c24d4e2f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.684654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bae0d-3444-4563-999a-75c24d4e2f6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.685196 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bae0d-3444-4563-999a-75c24d4e2f6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.686653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bae0d-3444-4563-999a-75c24d4e2f6f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.718879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.726051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86ca6e-d53f-41f5-a326-b450f59a7278 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.769644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206776cb-334c-43a1-9300-d462c07bd134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.771257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206776cb-334c-43a1-9300-d462c07bd134 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.771549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206776cb-334c-43a1-9300-d462c07bd134 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.771827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206776cb-334c-43a1-9300-d462c07bd134 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/b548998a91fb40519f794668c5c566af/roles/e8972a7e9ed3405c9912b4d0a12fa6f6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.784973 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 420/831] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:05.800100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206776cb-334c-43a1-9300-d462c07bd134 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=b548998a91fb40519f794668c5c566af, role_id=e8972a7e9ed3405c9912b4d0a12fa6f6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.801684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206776cb-334c-43a1-9300-d462c07bd134 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.898249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 412/832] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:05 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/b548998a91fb40519f794668c5c566af/roles/e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:55:05.908903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a0bb-bfca-4bde-b704-f691d952c527 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.909234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a0bb-bfca-4bde-b704-f691d952c527 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.909479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a0bb-bfca-4bde-b704-f691d952c527 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.911284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 421/833] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:05.917808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d81d09-7363-41ae-b771-cb9f7301f7b8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.918120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d81d09-7363-41ae-b771-cb9f7301f7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.918375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d81d09-7363-41ae-b771-cb9f7301f7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.938370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b9d81d09-7363-41ae-b771-cb9f7301f7b8 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:05.940169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b9d81d09-7363-41ae-b771-cb9f7301f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:06.030387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 413/834] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:06.054383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a0bb-bfca-4bde-b704-f691d952c527 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:06.136590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:06.191861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a0bb-bfca-4bde-b704-f691d952c527 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:06.228783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64e1a3-5997-430d-957b-ae1b74273102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:06.229598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64e1a3-5997-430d-957b-ae1b74273102 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:06.229879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64e1a3-5997-430d-957b-ae1b74273102 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:06.230155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64e1a3-5997-430d-957b-ae1b74273102 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:06.240817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64e1a3-5997-430d-957b-ae1b74273102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5d64e1a3-5997-430d-957b-ae1b74273102 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:06.248537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:06.249501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:06.250330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 422/835] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:06.268333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d81d09-7363-41ae-b771-cb9f7301f7b8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:06.349050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:06.373116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d81d09-7363-41ae-b771-cb9f7301f7b8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:06.409489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c05b1-dcd0-49d2-b7b3-9cfa6fe5122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:06.410168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c05b1-dcd0-49d2-b7b3-9cfa6fe5122d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:06.410452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c05b1-dcd0-49d2-b7b3-9cfa6fe5122d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:06.410726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c05b1-dcd0-49d2-b7b3-9cfa6fe5122d None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:06.411517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c05b1-dcd0-49d2-b7b3-9cfa6fe5122d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:06.411822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c05b1-dcd0-49d2-b7b3-9cfa6fe5122d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:06.413176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c05b1-dcd0-49d2-b7b3-9cfa6fe5122d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:06.422084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 414/836] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:06.427670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64e1a3-5997-430d-957b-ae1b74273102 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:06.530682 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64e1a3-5997-430d-957b-ae1b74273102 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:06.547375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:06.566283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f7b5d-c0fd-4239-9358-e89926e2e83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:06.567171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f7b5d-c0fd-4239-9358-e89926e2e83c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:06.567459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f7b5d-c0fd-4239-9358-e89926e2e83c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:06.567739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f7b5d-c0fd-4239-9358-e89926e2e83c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:06.579876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f7b5d-c0fd-4239-9358-e89926e2e83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:06.581314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f7b5d-c0fd-4239-9358-e89926e2e83c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d59f7b5d-c0fd-4239-9358-e89926e2e83c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:06.599072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:06.599990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:06.600882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:06.600882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:06.600882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:06.600882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:06.600882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 423/837] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:06.607232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c05b1-dcd0-49d2-b7b3-9cfa6fe5122d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:06.714116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c05b1-dcd0-49d2-b7b3-9cfa6fe5122d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:06.749446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb04b2b-8a34-421e-903f-2890e5677180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:06.750220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb04b2b-8a34-421e-903f-2890e5677180 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:06.750413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb04b2b-8a34-421e-903f-2890e5677180 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:06.750656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb04b2b-8a34-421e-903f-2890e5677180 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:06.751473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb04b2b-8a34-421e-903f-2890e5677180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:06.751780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb04b2b-8a34-421e-903f-2890e5677180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:06.753128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb04b2b-8a34-421e-903f-2890e5677180 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:06.754566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:06.766201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 415/838] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:06.771979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f7b5d-c0fd-4239-9358-e89926e2e83c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:06.877113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f7b5d-c0fd-4239-9358-e89926e2e83c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:06.911513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d93696-f8cf-4e20-9c82-f6e58077a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:06.912308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d93696-f8cf-4e20-9c82-f6e58077a777 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:06.912588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d93696-f8cf-4e20-9c82-f6e58077a777 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:06.912863 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d93696-f8cf-4e20-9c82-f6e58077a777 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:06.921155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d93696-f8cf-4e20-9c82-f6e58077a777 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:06.922587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d93696-f8cf-4e20-9c82-f6e58077a777 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-b6d93696-f8cf-4e20-9c82-f6e58077a777 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:06.937175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:06.938333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:06.939310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 424/839] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:06.945903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb04b2b-8a34-421e-903f-2890e5677180 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:07.056277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb04b2b-8a34-421e-903f-2890e5677180 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:07.093996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3158648-c20b-4cc8-a74a-8e465ffa7ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:07.094669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3158648-c20b-4cc8-a74a-8e465ffa7ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.094947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3158648-c20b-4cc8-a74a-8e465ffa7ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.095246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3158648-c20b-4cc8-a74a-8e465ffa7ac1 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.096078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3158648-c20b-4cc8-a74a-8e465ffa7ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:07.096386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3158648-c20b-4cc8-a74a-8e465ffa7ac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:07.097797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3158648-c20b-4cc8-a74a-8e465ffa7ac1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:07.116662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 416/840] 10.222.0.13 () {56 vars in 1135 bytes} [Thu Jun 2 09:55:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:07.124179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d93696-f8cf-4e20-9c82-f6e58077a777 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:07.154981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:07.235120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d93696-f8cf-4e20-9c82-f6e58077a777 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:07.273332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ff891-e5c0-4509-90a5-3ca98d360aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:07.273992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ff891-e5c0-4509-90a5-3ca98d360aeb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.274273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ff891-e5c0-4509-90a5-3ca98d360aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.274548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ff891-e5c0-4509-90a5-3ca98d360aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.382542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ff891-e5c0-4509-90a5-3ca98d360aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:07.387113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ff891-e5c0-4509-90a5-3ca98d360aeb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:07.412827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:07.430585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd092fa-eb58-4e33-8aa8-3852e4007818 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.434887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd092fa-eb58-4e33-8aa8-3852e4007818 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.434887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd092fa-eb58-4e33-8aa8-3852e4007818 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.434887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 417/841] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:07.440737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6736b0-9279-4172-aa81-a5025014af76 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.440737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6736b0-9279-4172-aa81-a5025014af76 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.440737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6736b0-9279-4172-aa81-a5025014af76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.497341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 425/842] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:07.501355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ed6736b0-9279-4172-aa81-a5025014af76 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:07.507115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ff891-e5c0-4509-90a5-3ca98d360aeb None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:07.514498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ed6736b0-9279-4172-aa81-a5025014af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:07.615188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:07.652191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 418/843] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:07.673482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6736b0-9279-4172-aa81-a5025014af76 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:07.678395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ff891-e5c0-4509-90a5-3ca98d360aeb None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:07.712042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:07.729949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f576-0350-40d5-b787-cb5d4d565273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:07.730758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f576-0350-40d5-b787-cb5d4d565273 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.731039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f576-0350-40d5-b787-cb5d4d565273 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.731383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f576-0350-40d5-b787-cb5d4d565273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.742235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02f576-0350-40d5-b787-cb5d4d565273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:07.743799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02f576-0350-40d5-b787-cb5d4d565273 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5e02f576-0350-40d5-b787-cb5d4d565273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:07.763162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:07.764108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:07.764997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:07.764997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:07.764997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:07.764997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:07.764997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 426/844] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:07.770766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f576-0350-40d5-b787-cb5d4d565273 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:07.801953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6736b0-9279-4172-aa81-a5025014af76 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:07.848431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262a3ab-f59a-4f58-b5c6-d795656cef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:07.850297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262a3ab-f59a-4f58-b5c6-d795656cef59 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.851031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262a3ab-f59a-4f58-b5c6-d795656cef59 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.851556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262a3ab-f59a-4f58-b5c6-d795656cef59 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.852415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262a3ab-f59a-4f58-b5c6-d795656cef59 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:07.854957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262a3ab-f59a-4f58-b5c6-d795656cef59 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2262a3ab-f59a-4f58-b5c6-d795656cef59 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:07.872735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:07.874741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:07.875639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:07.879292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 419/845] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:07.882451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262a3ab-f59a-4f58-b5c6-d795656cef59 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:07.899036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f576-0350-40d5-b787-cb5d4d565273 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:07.936033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff195e-7b30-4e99-ac8e-aa5b1db15fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:07.936607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff195e-7b30-4e99-ac8e-aa5b1db15fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.936931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff195e-7b30-4e99-ac8e-aa5b1db15fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.937208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff195e-7b30-4e99-ac8e-aa5b1db15fd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.937942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff195e-7b30-4e99-ac8e-aa5b1db15fd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:07.938251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff195e-7b30-4e99-ac8e-aa5b1db15fd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:07.939711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff195e-7b30-4e99-ac8e-aa5b1db15fd8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:07.951477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:07.958422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 427/846] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:07.959752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff195e-7b30-4e99-ac8e-aa5b1db15fd8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.008561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.033290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262a3ab-f59a-4f58-b5c6-d795656cef59 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.079168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff195e-7b30-4e99-ac8e-aa5b1db15fd8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.086326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35edede-6129-42bb-8a5d-e903a08d3321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.087263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35edede-6129-42bb-8a5d-e903a08d3321 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.088864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35edede-6129-42bb-8a5d-e903a08d3321 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.089295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35edede-6129-42bb-8a5d-e903a08d3321 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.090152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35edede-6129-42bb-8a5d-e903a08d3321 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:08.091044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35edede-6129-42bb-8a5d-e903a08d3321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.093551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35edede-6129-42bb-8a5d-e903a08d3321 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.100490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 420/847] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:08.106502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35edede-6129-42bb-8a5d-e903a08d3321 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.125869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb060265-de7f-4111-aad7-442a822c3b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.126672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060265-de7f-4111-aad7-442a822c3b2c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.126956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060265-de7f-4111-aad7-442a822c3b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.127269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060265-de7f-4111-aad7-442a822c3b2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.137518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb060265-de7f-4111-aad7-442a822c3b2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.139688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb060265-de7f-4111-aad7-442a822c3b2c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-eb060265-de7f-4111-aad7-442a822c3b2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:08.162427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:08.163415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:08.164334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:08.164334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:08.164334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:08.164334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:08.164334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:08.164334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:08.164334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:08.164334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:08.167191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 428/848] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:08.169474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb060265-de7f-4111-aad7-442a822c3b2c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.240742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35edede-6129-42bb-8a5d-e903a08d3321 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.258077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.286013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.289161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb060265-de7f-4111-aad7-442a822c3b2c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.294215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49952d52-7b6d-48d9-af6e-7fd5f6bb2275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.294892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49952d52-7b6d-48d9-af6e-7fd5f6bb2275 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.295205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49952d52-7b6d-48d9-af6e-7fd5f6bb2275 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.295484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49952d52-7b6d-48d9-af6e-7fd5f6bb2275 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.296506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49952d52-7b6d-48d9-af6e-7fd5f6bb2275 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:08.296506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49952d52-7b6d-48d9-af6e-7fd5f6bb2275 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.297958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49952d52-7b6d-48d9-af6e-7fd5f6bb2275 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.307010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 421/849] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:08.307010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b92b77-75d9-471e-89e1-57993ff5745c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.307010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b92b77-75d9-471e-89e1-57993ff5745c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.307010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b92b77-75d9-471e-89e1-57993ff5745c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.307010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 422/850] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:08.313259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406bf59-d958-4fc4-b911-6db76714e316 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.313606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406bf59-d958-4fc4-b911-6db76714e316 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.313832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406bf59-d958-4fc4-b911-6db76714e316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.333532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f406bf59-d958-4fc4-b911-6db76714e316 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:08.334613 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f406bf59-d958-4fc4-b911-6db76714e316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:08.339862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3f7e-f040-4b7f-aa97-2dd7dbae417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.340917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3f7e-f040-4b7f-aa97-2dd7dbae417a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.341427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3f7e-f040-4b7f-aa97-2dd7dbae417a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.342014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3f7e-f040-4b7f-aa97-2dd7dbae417a None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.343334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3f7e-f040-4b7f-aa97-2dd7dbae417a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:08.343885 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3f7e-f040-4b7f-aa97-2dd7dbae417a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.345459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3f7e-f040-4b7f-aa97-2dd7dbae417a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.366285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 429/851] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:08.367599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3f7e-f040-4b7f-aa97-2dd7dbae417a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.423195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 423/852] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:08.424677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd480b6-a39e-4a19-bbc8-46006a1f4de7 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.424968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd480b6-a39e-4a19-bbc8-46006a1f4de7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.425242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd480b6-a39e-4a19-bbc8-46006a1f4de7 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.426808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 424/853] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:08.432831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5685cc-6723-404b-b34a-d360267b113c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.433131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5685cc-6723-404b-b34a-d360267b113c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.433381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5685cc-6723-404b-b34a-d360267b113c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.452086 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7d5685cc-6723-404b-b34a-d360267b113c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:08.453336 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7d5685cc-6723-404b-b34a-d360267b113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:08.487186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3f7e-f040-4b7f-aa97-2dd7dbae417a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.526691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702ed6d-6362-4093-be49-4353af49670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.527387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ed6d-6362-4093-be49-4353af49670a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.527671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ed6d-6362-4093-be49-4353af49670a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.527941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702ed6d-6362-4093-be49-4353af49670a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.528779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702ed6d-6362-4093-be49-4353af49670a None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=ffbe700a0ebc48b5953a600400ecfed5) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:08.529099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702ed6d-6362-4093-be49-4353af49670a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.530264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 425/854] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:08.530610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702ed6d-6362-4093-be49-4353af49670a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.531122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5685cc-6723-404b-b34a-d360267b113c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.547302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 430/855] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/role_assignments?user.id=ffbe700a0ebc48b5953a600400ecfed5&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:08.554877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702ed6d-6362-4093-be49-4353af49670a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.570230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.600432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.645251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5685cc-6723-404b-b34a-d360267b113c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.682939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74229-d222-4b63-a8ad-031f6ca9d3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.683722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74229-d222-4b63-a8ad-031f6ca9d3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.684002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74229-d222-4b63-a8ad-031f6ca9d3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.684276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74229-d222-4b63-a8ad-031f6ca9d3a9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.684969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb74229-d222-4b63-a8ad-031f6ca9d3a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.686331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb74229-d222-4b63-a8ad-031f6ca9d3a9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.687566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702ed6d-6362-4093-be49-4353af49670a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1fb74229-d222-4b63-a8ad-031f6ca9d3a9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:08.700324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:08.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:08.702189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 426/856] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:08.711233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74229-d222-4b63-a8ad-031f6ca9d3a9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.733846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faab6c-b7e5-4c4b-b6e8-d707bad9bf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.735009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faab6c-b7e5-4c4b-b6e8-d707bad9bf92 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.735329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faab6c-b7e5-4c4b-b6e8-d707bad9bf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.735609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faab6c-b7e5-4c4b-b6e8-d707bad9bf92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.752138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4faab6c-b7e5-4c4b-b6e8-d707bad9bf92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-d4faab6c-b7e5-4c4b-b6e8-d707bad9bf92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:08.764411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:08.765492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:08.766531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 431/857] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:08.772542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faab6c-b7e5-4c4b-b6e8-d707bad9bf92 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.847206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.847206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74229-d222-4b63-a8ad-031f6ca9d3a9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.883011 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.890220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287a911-352e-4623-af50-8d6b1cfa855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.890996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287a911-352e-4623-af50-8d6b1cfa855c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.891379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287a911-352e-4623-af50-8d6b1cfa855c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.891799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287a911-352e-4623-af50-8d6b1cfa855c None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.892579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287a911-352e-4623-af50-8d6b1cfa855c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:08.892955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287a911-352e-4623-af50-8d6b1cfa855c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.894391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287a911-352e-4623-af50-8d6b1cfa855c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.903996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 427/858] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:08.905693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287a911-352e-4623-af50-8d6b1cfa855c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.913322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faab6c-b7e5-4c4b-b6e8-d707bad9bf92 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.952378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41975b1c-8487-45d7-a71f-d6bf672822a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.953439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41975b1c-8487-45d7-a71f-d6bf672822a1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.953940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41975b1c-8487-45d7-a71f-d6bf672822a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.954485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41975b1c-8487-45d7-a71f-d6bf672822a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.955534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41975b1c-8487-45d7-a71f-d6bf672822a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:08.956022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41975b1c-8487-45d7-a71f-d6bf672822a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.957608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41975b1c-8487-45d7-a71f-d6bf672822a1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.968154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 432/859] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:08.973185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41975b1c-8487-45d7-a71f-d6bf672822a1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.024031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287a911-352e-4623-af50-8d6b1cfa855c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.061355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d8e67-466b-45bd-9392-9c6f40ba53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.062495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d8e67-466b-45bd-9392-9c6f40ba53ce None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.063026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d8e67-466b-45bd-9392-9c6f40ba53ce None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.063526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d8e67-466b-45bd-9392-9c6f40ba53ce None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.064422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d8e67-466b-45bd-9392-9c6f40ba53ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:09.064921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d8e67-466b-45bd-9392-9c6f40ba53ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.066492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d8e67-466b-45bd-9392-9c6f40ba53ce None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.071889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 428/860] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:09.092358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41975b1c-8487-45d7-a71f-d6bf672822a1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.133404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a49ca-b28b-4349-9f83-b5f5178dc91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.134140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a49ca-b28b-4349-9f83-b5f5178dc91c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.134418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a49ca-b28b-4349-9f83-b5f5178dc91c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.134739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a49ca-b28b-4349-9f83-b5f5178dc91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.147759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a49ca-b28b-4349-9f83-b5f5178dc91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.149236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a49ca-b28b-4349-9f83-b5f5178dc91c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.157001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1d7a49ca-b28b-4349-9f83-b5f5178dc91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:09.169971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:09.172904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:09.174995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:09.174995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:09.174995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:09.174995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:09.174995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 433/861] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:09.181610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d8e67-466b-45bd-9392-9c6f40ba53ce None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.214758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:09.296840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d8e67-466b-45bd-9392-9c6f40ba53ce None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.332978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531b80-7e92-496f-9cff-687fabb0678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.333694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531b80-7e92-496f-9cff-687fabb0678f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.333970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531b80-7e92-496f-9cff-687fabb0678f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.334271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531b80-7e92-496f-9cff-687fabb0678f None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.335034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b531b80-7e92-496f-9cff-687fabb0678f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:09.335369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b531b80-7e92-496f-9cff-687fabb0678f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.336712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b531b80-7e92-496f-9cff-687fabb0678f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.349337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 429/862] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:09.357165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a49ca-b28b-4349-9f83-b5f5178dc91c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.471017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a49ca-b28b-4349-9f83-b5f5178dc91c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.505905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d90d99-411b-4ab5-9131-6ae81029e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.506994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d90d99-411b-4ab5-9131-6ae81029e09b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.507473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d90d99-411b-4ab5-9131-6ae81029e09b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.507944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d90d99-411b-4ab5-9131-6ae81029e09b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.516396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d90d99-411b-4ab5-9131-6ae81029e09b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.518579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d90d99-411b-4ab5-9131-6ae81029e09b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f9d90d99-411b-4ab5-9131-6ae81029e09b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:09.533143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:09.534097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:09.535049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:09.537242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 434/863] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:09.543175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531b80-7e92-496f-9cff-687fabb0678f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.632130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:09.650737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531b80-7e92-496f-9cff-687fabb0678f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.686275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f12f5b-a0fd-46d2-9295-89eedbcc8cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.686953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f12f5b-a0fd-46d2-9295-89eedbcc8cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.687259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f12f5b-a0fd-46d2-9295-89eedbcc8cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.687572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f12f5b-a0fd-46d2-9295-89eedbcc8cc1 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.688408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f12f5b-a0fd-46d2-9295-89eedbcc8cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:09.688709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f12f5b-a0fd-46d2-9295-89eedbcc8cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.690124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f12f5b-a0fd-46d2-9295-89eedbcc8cc1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.707784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 430/864] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:09.713497 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d90d99-411b-4ab5-9131-6ae81029e09b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.779473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:09.822201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d90d99-411b-4ab5-9131-6ae81029e09b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.857488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e9108-ca2d-43a6-a485-bd1ce57a8d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.858137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e9108-ca2d-43a6-a485-bd1ce57a8d56 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.858418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e9108-ca2d-43a6-a485-bd1ce57a8d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.858696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e9108-ca2d-43a6-a485-bd1ce57a8d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.928209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e9108-ca2d-43a6-a485-bd1ce57a8d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.929661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e9108-ca2d-43a6-a485-bd1ce57a8d56 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.988124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.031859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 435/865] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:10.037395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f12f5b-a0fd-46d2-9295-89eedbcc8cc1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.137939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f12f5b-a0fd-46d2-9295-89eedbcc8cc1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.172855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e05f-0b5b-42de-a628-4190f57057f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.174058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e05f-0b5b-42de-a628-4190f57057f6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.174533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e05f-0b5b-42de-a628-4190f57057f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.175013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e05f-0b5b-42de-a628-4190f57057f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.185307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2e05f-0b5b-42de-a628-4190f57057f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.187059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2e05f-0b5b-42de-a628-4190f57057f6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.189807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-bef2e05f-0b5b-42de-a628-4190f57057f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:10.205535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:10.212361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:10.213902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:10.213902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:10.213902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:10.213902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:10.213902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 431/866] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:10.214198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e9108-ca2d-43a6-a485-bd1ce57a8d56 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.314988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e9108-ca2d-43a6-a485-bd1ce57a8d56 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.353888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dc638-b960-41e8-ae25-88eb7a388c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.354960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dc638-b960-41e8-ae25-88eb7a388c54 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.355468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dc638-b960-41e8-ae25-88eb7a388c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.355963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dc638-b960-41e8-ae25-88eb7a388c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.356885 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dc638-b960-41e8-ae25-88eb7a388c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:10.357405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dc638-b960-41e8-ae25-88eb7a388c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.358975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dc638-b960-41e8-ae25-88eb7a388c54 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.373055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 436/867] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:10.380315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e05f-0b5b-42de-a628-4190f57057f6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.490835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e05f-0b5b-42de-a628-4190f57057f6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.527530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9ad45-1c3f-4f5d-9bc1-76771e323b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.528692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9ad45-1c3f-4f5d-9bc1-76771e323b49 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.529175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9ad45-1c3f-4f5d-9bc1-76771e323b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.529677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9ad45-1c3f-4f5d-9bc1-76771e323b49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.536763 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9ad45-1c3f-4f5d-9bc1-76771e323b49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.538391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9ad45-1c3f-4f5d-9bc1-76771e323b49 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-93b9ad45-1c3f-4f5d-9bc1-76771e323b49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:10.552333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:10.553262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:10.554153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:10.554153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:10.554153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:10.554153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:10.554153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:10.554153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:10.554153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:10.554153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:10.556789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 432/868] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:10.564083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dc638-b960-41e8-ae25-88eb7a388c54 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.584467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.672735 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dc638-b960-41e8-ae25-88eb7a388c54 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.706974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6cb5b-070e-4377-b0e2-630c9908ae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.707659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6cb5b-070e-4377-b0e2-630c9908ae69 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.707938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6cb5b-070e-4377-b0e2-630c9908ae69 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.708211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6cb5b-070e-4377-b0e2-630c9908ae69 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.708991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6cb5b-070e-4377-b0e2-630c9908ae69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:10.709297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6cb5b-070e-4377-b0e2-630c9908ae69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.710721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6cb5b-070e-4377-b0e2-630c9908ae69 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.724826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 437/869] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:10.730451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9ad45-1c3f-4f5d-9bc1-76771e323b49 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.764603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397cfb5-a60e-4b72-bda2-0b90b6129f54 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.764891 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397cfb5-a60e-4b72-bda2-0b90b6129f54 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.765165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397cfb5-a60e-4b72-bda2-0b90b6129f54 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.766778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 438/870] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:10.771699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93769557-0fd2-4eb5-aea4-1880a76b8e29 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.771985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93769557-0fd2-4eb5-aea4-1880a76b8e29 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.772262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93769557-0fd2-4eb5-aea4-1880a76b8e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.789507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-93769557-0fd2-4eb5-aea4-1880a76b8e29 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:10.790713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-93769557-0fd2-4eb5-aea4-1880a76b8e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:10.793137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.843069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9ad45-1c3f-4f5d-9bc1-76771e323b49 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.865763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 439/871] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:10.890635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93769557-0fd2-4eb5-aea4-1880a76b8e29 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.890951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b323-39b7-46a8-a8ef-4750fe96d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.891551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b323-39b7-46a8-a8ef-4750fe96d08c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.891835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b323-39b7-46a8-a8ef-4750fe96d08c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.892110 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b323-39b7-46a8-a8ef-4750fe96d08c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.893066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44b323-39b7-46a8-a8ef-4750fe96d08c None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=b548998a91fb40519f794668c5c566af) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:10.893381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44b323-39b7-46a8-a8ef-4750fe96d08c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.895046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44b323-39b7-46a8-a8ef-4750fe96d08c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.901283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.902467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 433/872] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/role_assignments?user.id=b548998a91fb40519f794668c5c566af&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:10.905822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510e4ef-82d5-4e21-b75c-fe914a17319f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.906261 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510e4ef-82d5-4e21-b75c-fe914a17319f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.906551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510e4ef-82d5-4e21-b75c-fe914a17319f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.909052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 434/873] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:10.914722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d15559-3180-4d2b-b3e1-4b71a2a0ffd4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.915853 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d15559-3180-4d2b-b3e1-4b71a2a0ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.915853 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d15559-3180-4d2b-b3e1-4b71a2a0ffd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.933726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e8d15559-3180-4d2b-b3e1-4b71a2a0ffd4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:10.934993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e8d15559-3180-4d2b-b3e1-4b71a2a0ffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:11.012851 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93769557-0fd2-4eb5-aea4-1880a76b8e29 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:11.019540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 435/874] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:11.035201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d15559-3180-4d2b-b3e1-4b71a2a0ffd4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:11.057882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39947c4-c70d-4c8f-b459-4bef59d00d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:11.058572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39947c4-c70d-4c8f-b459-4bef59d00d90 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.058854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39947c4-c70d-4c8f-b459-4bef59d00d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.059153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39947c4-c70d-4c8f-b459-4bef59d00d90 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.059902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39947c4-c70d-4c8f-b459-4bef59d00d90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.061924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39947c4-c70d-4c8f-b459-4bef59d00d90 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.095651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:11.149792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d15559-3180-4d2b-b3e1-4b71a2a0ffd4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:11.156311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 440/875] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:10 2022] POST /identity/v3/services => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:11.204819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fed834-2874-490e-9f59-0967fb96561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:11.205648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fed834-2874-490e-9f59-0967fb96561e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.205931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fed834-2874-490e-9f59-0967fb96561e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.206201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fed834-2874-490e-9f59-0967fb96561e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.206861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fed834-2874-490e-9f59-0967fb96561e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.208457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fed834-2874-490e-9f59-0967fb96561e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-70fed834-2874-490e-9f59-0967fb96561e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:11.224169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:11.225259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:11.226139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 436/876] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:11.231948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39947c4-c70d-4c8f-b459-4bef59d00d90 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:11.323582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:11.357595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39947c4-c70d-4c8f-b459-4bef59d00d90 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:11.394605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4117c-fa29-4fed-884e-e415f34ee617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:11.395414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4117c-fa29-4fed-884e-e415f34ee617 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.395767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4117c-fa29-4fed-884e-e415f34ee617 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.396120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4117c-fa29-4fed-884e-e415f34ee617 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.396905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4117c-fa29-4fed-884e-e415f34ee617 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:11.397335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4117c-fa29-4fed-884e-e415f34ee617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.398775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4117c-fa29-4fed-884e-e415f34ee617 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.404440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 441/877] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:11.409977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fed834-2874-490e-9f59-0967fb96561e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:11.524716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fed834-2874-490e-9f59-0967fb96561e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:11.536582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:11.561512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385d4c4-391a-4a90-be97-f55a6d1ae511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:11.562488 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d4c4-391a-4a90-be97-f55a6d1ae511 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.563286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d4c4-391a-4a90-be97-f55a6d1ae511 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.564258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d4c4-391a-4a90-be97-f55a6d1ae511 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.565154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385d4c4-391a-4a90-be97-f55a6d1ae511 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:11.565645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385d4c4-391a-4a90-be97-f55a6d1ae511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.567221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385d4c4-391a-4a90-be97-f55a6d1ae511 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.572861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 437/878] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:11.578988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd452-857e-4353-afb0-7d57b9291f3d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.579622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd452-857e-4353-afb0-7d57b9291f3d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.580082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd452-857e-4353-afb0-7d57b9291f3d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.581773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 442/879] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:11.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfbaae-39e0-4fb8-80b9-4ebdb6963b35 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.588318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfbaae-39e0-4fb8-80b9-4ebdb6963b35 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.588598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfbaae-39e0-4fb8-80b9-4ebdb6963b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.607024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-60dfbaae-39e0-4fb8-80b9-4ebdb6963b35 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:11.608352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-60dfbaae-39e0-4fb8-80b9-4ebdb6963b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:11.684682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 438/880] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:11.704669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccd452-857e-4353-afb0-7d57b9291f3d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:11.818259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccd452-857e-4353-afb0-7d57b9291f3d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:11.850135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:11.855657 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101607e-ee1d-49c2-b711-13d3c9f7f41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:11.856567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101607e-ee1d-49c2-b711-13d3c9f7f41b None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.857065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101607e-ee1d-49c2-b711-13d3c9f7f41b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.863932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101607e-ee1d-49c2-b711-13d3c9f7f41b None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.863932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101607e-ee1d-49c2-b711-13d3c9f7f41b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.863932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101607e-ee1d-49c2-b711-13d3c9f7f41b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.971230 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 443/881] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:11 2022] POST /identity/v3/services => generated 269 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:13.385222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325fc6-5237-4582-bab7-9127900bfedc None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.385797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325fc6-5237-4582-bab7-9127900bfedc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.385797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325fc6-5237-4582-bab7-9127900bfedc None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.387399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 439/882] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:13.392814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e118a7-52f4-477d-a089-d5ac553cf44a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.393297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e118a7-52f4-477d-a089-d5ac553cf44a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.393385 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e118a7-52f4-477d-a089-d5ac553cf44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.410732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-87e118a7-52f4-477d-a089-d5ac553cf44a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:13.411939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-87e118a7-52f4-477d-a089-d5ac553cf44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:13.489542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 444/883] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:13.513586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325fc6-5237-4582-bab7-9127900bfedc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:13.580531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f32c-b1c2-4cff-8c1d-e6e770d5889b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.580868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f32c-b1c2-4cff-8c1d-e6e770d5889b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.581098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f32c-b1c2-4cff-8c1d-e6e770d5889b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.582617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 445/884] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:13.587525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56888a-b1ed-4f72-9da0-a08ab4a325fc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.587812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56888a-b1ed-4f72-9da0-a08ab4a325fc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.588092 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56888a-b1ed-4f72-9da0-a08ab4a325fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.605787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-da56888a-b1ed-4f72-9da0-a08ab4a325fc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:13.607085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-da56888a-b1ed-4f72-9da0-a08ab4a325fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:13.635731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325fc6-5237-4582-bab7-9127900bfedc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:13.638532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:13.673095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2657f-4e84-4aa1-a84d-7cabdc37a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:13.674183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2657f-4e84-4aa1-a84d-7cabdc37a8bb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.674614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2657f-4e84-4aa1-a84d-7cabdc37a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.675045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2657f-4e84-4aa1-a84d-7cabdc37a8bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.686750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 446/885] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:13.699124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2657f-4e84-4aa1-a84d-7cabdc37a8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5ab2657f-4e84-4aa1-a84d-7cabdc37a8bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:13.700611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:13.701603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:13.702493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 440/886] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:13.709656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56888a-b1ed-4f72-9da0-a08ab4a325fc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:13.710973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2657f-4e84-4aa1-a84d-7cabdc37a8bb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:13.773698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:13.841237 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56888a-b1ed-4f72-9da0-a08ab4a325fc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:13.844696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2657f-4e84-4aa1-a84d-7cabdc37a8bb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:13.882337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4305d-47e7-44d6-b503-26f55c021820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:13.883457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4305d-47e7-44d6-b503-26f55c021820 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.883741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4305d-47e7-44d6-b503-26f55c021820 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.884014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4305d-47e7-44d6-b503-26f55c021820 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.884719 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4305d-47e7-44d6-b503-26f55c021820 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:13.886067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4305d-47e7-44d6-b503-26f55c021820 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:13.887441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8b575-bdb1-4135-b727-0d6e82a34465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:13.888398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8b575-bdb1-4135-b727-0d6e82a34465 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.889079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8b575-bdb1-4135-b727-0d6e82a34465 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.889364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8b575-bdb1-4135-b727-0d6e82a34465 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.890438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8b575-bdb1-4135-b727-0d6e82a34465 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:13.890752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8b575-bdb1-4135-b727-0d6e82a34465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:13.892141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8b575-bdb1-4135-b727-0d6e82a34465 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-66c4305d-47e7-44d6-b503-26f55c021820 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:13.898195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:13.899565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:13.901260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 441/887] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:13.902048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59761043-878b-41fa-919d-fc869bbf0f22 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.902121 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59761043-878b-41fa-919d-fc869bbf0f22 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.902412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59761043-878b-41fa-919d-fc869bbf0f22 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.907135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 442/888] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:13.907281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 447/889] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:13.907366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59761043-878b-41fa-919d-fc869bbf0f22 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:13.907447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8b575-bdb1-4135-b727-0d6e82a34465 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:13.937020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.019819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59761043-878b-41fa-919d-fc869bbf0f22 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.022328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8b575-bdb1-4135-b727-0d6e82a34465 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.033773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.057865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb6fbc-21ba-4246-82fd-a090a65671d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.058746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb6fbc-21ba-4246-82fd-a090a65671d2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.059026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb6fbc-21ba-4246-82fd-a090a65671d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.059333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb6fbc-21ba-4246-82fd-a090a65671d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.059437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765957e-ce58-475a-82ef-8f830fc33745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.059995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765957e-ce58-475a-82ef-8f830fc33745 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.060280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765957e-ce58-475a-82ef-8f830fc33745 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.060557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765957e-ce58-475a-82ef-8f830fc33745 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.061319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765957e-ce58-475a-82ef-8f830fc33745 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:14.061625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765957e-ce58-475a-82ef-8f830fc33745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.062974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765957e-ce58-475a-82ef-8f830fc33745 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.071550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 443/890] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:14.071550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba871ab-596f-4ee6-a787-8d37346b5100 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.071550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba871ab-596f-4ee6-a787-8d37346b5100 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.071550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba871ab-596f-4ee6-a787-8d37346b5100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.076447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb6fbc-21ba-4246-82fd-a090a65671d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.077891 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb6fbc-21ba-4246-82fd-a090a65671d2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.091360 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4ba871ab-596f-4ee6-a787-8d37346b5100 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:14.092779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4ba871ab-596f-4ee6-a787-8d37346b5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-25eb6fbc-21ba-4246-82fd-a090a65671d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:14.096574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:14.097462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:14.098370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:14.098370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:14.098370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:14.098370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:14.098370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 448/891] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:14.099076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb6fbc-21ba-4246-82fd-a090a65671d2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.166077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 444/892] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:14.166931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba871ab-596f-4ee6-a787-8d37346b5100 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.192965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.212825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb6fbc-21ba-4246-82fd-a090a65671d2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.248036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee529099-4ebb-45e5-afce-186d85c8a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.249041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee529099-4ebb-45e5-afce-186d85c8a873 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.249323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee529099-4ebb-45e5-afce-186d85c8a873 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.249600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee529099-4ebb-45e5-afce-186d85c8a873 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.250302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee529099-4ebb-45e5-afce-186d85c8a873 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:14.250608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee529099-4ebb-45e5-afce-186d85c8a873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.252004 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee529099-4ebb-45e5-afce-186d85c8a873 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.257515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 449/893] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:14.257755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee529099-4ebb-45e5-afce-186d85c8a873 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.292129 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.292332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba871ab-596f-4ee6-a787-8d37346b5100 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.329091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707658ff-c403-4702-9ca7-ea8849713c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.329754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707658ff-c403-4702-9ca7-ea8849713c3e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.330034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707658ff-c403-4702-9ca7-ea8849713c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.330307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707658ff-c403-4702-9ca7-ea8849713c3e None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.331022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707658ff-c403-4702-9ca7-ea8849713c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:14.331356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707658ff-c403-4702-9ca7-ea8849713c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.332706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707658ff-c403-4702-9ca7-ea8849713c3e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.345238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 445/894] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:14.345979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707658ff-c403-4702-9ca7-ea8849713c3e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.366357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee529099-4ebb-45e5-afce-186d85c8a873 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.400244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875fec5-232b-4dc4-ae53-91020e6e83e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.400920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875fec5-232b-4dc4-ae53-91020e6e83e7 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.401206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875fec5-232b-4dc4-ae53-91020e6e83e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.401479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875fec5-232b-4dc4-ae53-91020e6e83e7 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.402195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875fec5-232b-4dc4-ae53-91020e6e83e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.404179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875fec5-232b-4dc4-ae53-91020e6e83e7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.430811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.448740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707658ff-c403-4702-9ca7-ea8849713c3e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.481408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 450/895] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:14 2022] POST /identity/v3/services => generated 241 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:14.482772 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c226c0-970f-4b88-84ee-d242810ed078 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.483065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c226c0-970f-4b88-84ee-d242810ed078 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.483369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c226c0-970f-4b88-84ee-d242810ed078 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.484829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 451/896] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:14.485574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c226c0-970f-4b88-84ee-d242810ed078 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.492769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c1d3c-b3fd-4493-aa47-f5f99e876fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.493511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c1d3c-b3fd-4493-aa47-f5f99e876fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.493793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c1d3c-b3fd-4493-aa47-f5f99e876fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.494067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c1d3c-b3fd-4493-aa47-f5f99e876fc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.494884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c1d3c-b3fd-4493-aa47-f5f99e876fc6 None admin] RBAC: Adding query filter params (interface=public, service_id=36e6675f2d224472a17d5eca83026649, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:14.495227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c1d3c-b3fd-4493-aa47-f5f99e876fc6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.496824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c1d3c-b3fd-4493-aa47-f5f99e876fc6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.505725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 446/897] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/endpoints?service_id=36e6675f2d224472a17d5eca83026649&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:14.512094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5001-5d8a-4e26-9771-29186efcd993 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.512402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5001-5d8a-4e26-9771-29186efcd993 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.512734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac5001-5d8a-4e26-9771-29186efcd993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.532087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-69ac5001-5d8a-4e26-9771-29186efcd993 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:14.533309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-69ac5001-5d8a-4e26-9771-29186efcd993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:14.597602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.612302 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 447/898] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:14.613172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac5001-5d8a-4e26-9771-29186efcd993 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.628173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c226c0-970f-4b88-84ee-d242810ed078 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.672877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af08bdd-35b4-4d18-a523-d41489c73d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.673696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af08bdd-35b4-4d18-a523-d41489c73d12 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.673992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af08bdd-35b4-4d18-a523-d41489c73d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.674254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af08bdd-35b4-4d18-a523-d41489c73d12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.683127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af08bdd-35b4-4d18-a523-d41489c73d12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.684609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af08bdd-35b4-4d18-a523-d41489c73d12 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.694321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-5af08bdd-35b4-4d18-a523-d41489c73d12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:14.700352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:14.701359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 452/899] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:14.702391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af08bdd-35b4-4d18-a523-d41489c73d12 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.735088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac5001-5d8a-4e26-9771-29186efcd993 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.774003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daf5c4-b82e-478d-a071-5f0583962bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.774972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf5c4-b82e-478d-a071-5f0583962bfb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.775283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf5c4-b82e-478d-a071-5f0583962bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.775558 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf5c4-b82e-478d-a071-5f0583962bfb None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.776403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daf5c4-b82e-478d-a071-5f0583962bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.778562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daf5c4-b82e-478d-a071-5f0583962bfb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.795137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 448/900] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:14.795137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daf5c4-b82e-478d-a071-5f0583962bfb None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.810496 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af08bdd-35b4-4d18-a523-d41489c73d12 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.859690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d30601-994b-4a83-8549-6735013cac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.861607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d30601-994b-4a83-8549-6735013cac78 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.862113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d30601-994b-4a83-8549-6735013cac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.863082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d30601-994b-4a83-8549-6735013cac78 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.864326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d30601-994b-4a83-8549-6735013cac78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.866369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d30601-994b-4a83-8549-6735013cac78 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-74d30601-994b-4a83-8549-6735013cac78 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:14.886619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:14.894378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:14.895304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 453/901] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:14.897533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d30601-994b-4a83-8549-6735013cac78 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.918352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.937698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daf5c4-b82e-478d-a071-5f0583962bfb None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.990598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b9336-1488-4f7d-924a-9fd4964623db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.991352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b9336-1488-4f7d-924a-9fd4964623db None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.991660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b9336-1488-4f7d-924a-9fd4964623db None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.991933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b9336-1488-4f7d-924a-9fd4964623db None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.992784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b9336-1488-4f7d-924a-9fd4964623db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:14.993207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b9336-1488-4f7d-924a-9fd4964623db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.995289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b9336-1488-4f7d-924a-9fd4964623db None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.999151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:15.021405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 449/902] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:15.027272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b9336-1488-4f7d-924a-9fd4964623db None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:15.033370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d30601-994b-4a83-8549-6735013cac78 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.070042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfa3c2-87ec-4adc-9378-1570b0948701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.070774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfa3c2-87ec-4adc-9378-1570b0948701 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.071069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfa3c2-87ec-4adc-9378-1570b0948701 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.071376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfa3c2-87ec-4adc-9378-1570b0948701 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.072174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfa3c2-87ec-4adc-9378-1570b0948701 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:15.072496 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfa3c2-87ec-4adc-9378-1570b0948701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.073868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfa3c2-87ec-4adc-9378-1570b0948701 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.079131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 454/903] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:15.084549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfa3c2-87ec-4adc-9378-1570b0948701 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:15.136120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b9336-1488-4f7d-924a-9fd4964623db None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.171507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:15.171810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c44a5-00c7-4b36-95eb-0c56f54f9c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.172439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c44a5-00c7-4b36-95eb-0c56f54f9c1c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.172724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c44a5-00c7-4b36-95eb-0c56f54f9c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.173000 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c44a5-00c7-4b36-95eb-0c56f54f9c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.190533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfa3c2-87ec-4adc-9378-1570b0948701 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.228036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066f5b-2d4f-4d6a-8397-63d6dab009db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.228920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066f5b-2d4f-4d6a-8397-63d6dab009db None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.229311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066f5b-2d4f-4d6a-8397-63d6dab009db None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.229716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066f5b-2d4f-4d6a-8397-63d6dab009db None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.230562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9066f5b-2d4f-4d6a-8397-63d6dab009db None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:15.230977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9066f5b-2d4f-4d6a-8397-63d6dab009db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.232530 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9066f5b-2d4f-4d6a-8397-63d6dab009db None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.239959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:15.242626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 455/904] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:15.243942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066f5b-2d4f-4d6a-8397-63d6dab009db None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:15.249549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c44a5-00c7-4b36-95eb-0c56f54f9c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.258850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c44a5-00c7-4b36-95eb-0c56f54f9c1c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.351380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066f5b-2d4f-4d6a-8397-63d6dab009db None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.374503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 450/905] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 09:55:15.375722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c44a5-00c7-4b36-95eb-0c56f54f9c1c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:15.388366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6218b-a19d-4783-924d-c75c8f924932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.388937 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6218b-a19d-4783-924d-c75c8f924932 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.389220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6218b-a19d-4783-924d-c75c8f924932 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.389502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6218b-a19d-4783-924d-c75c8f924932 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.390353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6218b-a19d-4783-924d-c75c8f924932 None admin] RBAC: Adding query filter params (interface=public, service_id=b7b0ce50ad484664a14d0cdb722b3b97, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:15.390670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6218b-a19d-4783-924d-c75c8f924932 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.392124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6218b-a19d-4783-924d-c75c8f924932 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.397890 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 456/906] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/endpoints?service_id=b7b0ce50ad484664a14d0cdb722b3b97&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:15.404140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6218b-a19d-4783-924d-c75c8f924932 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:15.420317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:15.480990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:15.489405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c44a5-00c7-4b36-95eb-0c56f54f9c1c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.524808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6218b-a19d-4783-924d-c75c8f924932 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.528676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4510be-1a58-4026-9c29-fcefa4560450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.529709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4510be-1a58-4026-9c29-fcefa4560450 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.530171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4510be-1a58-4026-9c29-fcefa4560450 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.530622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4510be-1a58-4026-9c29-fcefa4560450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.542171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4510be-1a58-4026-9c29-fcefa4560450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.544056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4510be-1a58-4026-9c29-fcefa4560450 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.561467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169e831-62e4-4a2a-aea0-632763f99b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.562216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e831-62e4-4a2a-aea0-632763f99b45 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.562568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e831-62e4-4a2a-aea0-632763f99b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.562910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e831-62e4-4a2a-aea0-632763f99b45 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.563712 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169e831-62e4-4a2a-aea0-632763f99b45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.565137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169e831-62e4-4a2a-aea0-632763f99b45 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-de4510be-1a58-4026-9c29-fcefa4560450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:15.565471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:15.566329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:15.567267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:15.567267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:15.567267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:15.567267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:15.574368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 457/907] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:15.574884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 451/908] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:15.575566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169e831-62e4-4a2a-aea0-632763f99b45 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:15.653203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:15.693474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169e831-62e4-4a2a-aea0-632763f99b45 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.731373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96ffcc-d306-466a-983a-328091a5bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.732053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96ffcc-d306-466a-983a-328091a5bb00 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.732334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96ffcc-d306-466a-983a-328091a5bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.732607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96ffcc-d306-466a-983a-328091a5bb00 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.733336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96ffcc-d306-466a-983a-328091a5bb00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:15.733640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96ffcc-d306-466a-983a-328091a5bb00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.735114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96ffcc-d306-466a-983a-328091a5bb00 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.749611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 458/909] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:15.755333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4510be-1a58-4026-9c29-fcefa4560450 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:15.861154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4510be-1a58-4026-9c29-fcefa4560450 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.896417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a906276-83f7-4e13-8b6b-20796e007e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.897210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a906276-83f7-4e13-8b6b-20796e007e62 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.897493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a906276-83f7-4e13-8b6b-20796e007e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.897769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a906276-83f7-4e13-8b6b-20796e007e62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.904854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a906276-83f7-4e13-8b6b-20796e007e62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.906287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a906276-83f7-4e13-8b6b-20796e007e62 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-3a906276-83f7-4e13-8b6b-20796e007e62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:15.920738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:15.921703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:15.922615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:15.922615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:15.922615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:15.922615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:15.922615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:15.922615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:15.922615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:15.922615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:15.922615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 452/910] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:15.929620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96ffcc-d306-466a-983a-328091a5bb00 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:16.034233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96ffcc-d306-466a-983a-328091a5bb00 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:16.062641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:16.072725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd415-241d-4a18-b5e3-4ae0a3cfbac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:16.073396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd415-241d-4a18-b5e3-4ae0a3cfbac3 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:16.077512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd415-241d-4a18-b5e3-4ae0a3cfbac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:16.077512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd415-241d-4a18-b5e3-4ae0a3cfbac3 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:16.077512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd415-241d-4a18-b5e3-4ae0a3cfbac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:16.077512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd415-241d-4a18-b5e3-4ae0a3cfbac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:16.077512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd415-241d-4a18-b5e3-4ae0a3cfbac3 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:16.089413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 459/911] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:16.095536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a906276-83f7-4e13-8b6b-20796e007e62 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:16.105661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:16.202151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a906276-83f7-4e13-8b6b-20796e007e62 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:16.237290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd6dcb-245d-4b8c-af3e-6ae8c2d36c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:16.237950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6dcb-245d-4b8c-af3e-6ae8c2d36c77 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:16.238234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6dcb-245d-4b8c-af3e-6ae8c2d36c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:16.238508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6dcb-245d-4b8c-af3e-6ae8c2d36c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:16.239369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6dcb-245d-4b8c-af3e-6ae8c2d36c77 None admin] RBAC: Adding query filter params (role.id=407071ed54014753a3e4d05e5b145946, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=b548998a91fb40519f794668c5c566af) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:16.239682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6dcb-245d-4b8c-af3e-6ae8c2d36c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:16.241105 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6dcb-245d-4b8c-af3e-6ae8c2d36c77 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:16.247146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 453/912] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:16 2022] GET /identity/v3/role_assignments?user.id=b548998a91fb40519f794668c5c566af&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=407071ed54014753a3e4d05e5b145946 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:16.842497 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7113e-beeb-4f0e-ba67-4c5fd08e5c1a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:16.843022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7113e-beeb-4f0e-ba67-4c5fd08e5c1a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:16.843022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7113e-beeb-4f0e-ba67-4c5fd08e5c1a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:16.848506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 460/913] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:16.850028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b41c5-e24b-4b96-96af-b7f11a4eb3ac None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:16.850439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b41c5-e24b-4b96-96af-b7f11a4eb3ac None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:16.850589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b41c5-e24b-4b96-96af-b7f11a4eb3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:16.867919 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-823b41c5-e24b-4b96-96af-b7f11a4eb3ac None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:16.869610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-823b41c5-e24b-4b96-96af-b7f11a4eb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:16.937183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:16.942091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 454/914] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:16.965392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7113e-beeb-4f0e-ba67-4c5fd08e5c1a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.074798 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7113e-beeb-4f0e-ba67-4c5fd08e5c1a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.109087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5006b-aeab-4a2c-b091-93905e8e23eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.109862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5006b-aeab-4a2c-b091-93905e8e23eb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.110139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5006b-aeab-4a2c-b091-93905e8e23eb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.110413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5006b-aeab-4a2c-b091-93905e8e23eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.111121 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5006b-aeab-4a2c-b091-93905e8e23eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.112473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5006b-aeab-4a2c-b091-93905e8e23eb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3fe5006b-aeab-4a2c-b091-93905e8e23eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:17.125236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:17.126224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:17.127051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 461/915] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:17.132611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b41c5-e24b-4b96-96af-b7f11a4eb3ac None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.169002 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0fcf2-519e-4e95-808b-74029ae238e2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.169338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0fcf2-519e-4e95-808b-74029ae238e2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.169558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0fcf2-519e-4e95-808b-74029ae238e2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.174715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 462/916] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:17.175877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5446-9c19-4777-901d-24616b65a4ec None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.176163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5446-9c19-4777-901d-24616b65a4ec None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.176438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5446-9c19-4777-901d-24616b65a4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.195928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fd5b5446-9c19-4777-901d-24616b65a4ec None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:17.197325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fd5b5446-9c19-4777-901d-24616b65a4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:17.237579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b41c5-e24b-4b96-96af-b7f11a4eb3ac None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.258516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:17.283906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379df6a-8110-4141-9979-7aee64ff3259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.284879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379df6a-8110-4141-9979-7aee64ff3259 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.285392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379df6a-8110-4141-9979-7aee64ff3259 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.285882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379df6a-8110-4141-9979-7aee64ff3259 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.286787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379df6a-8110-4141-9979-7aee64ff3259 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:17.287333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379df6a-8110-4141-9979-7aee64ff3259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.288884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379df6a-8110-4141-9979-7aee64ff3259 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.291065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 463/917] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:17.295261 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 455/918] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:17.303149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5446-9c19-4777-901d-24616b65a4ec None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.312904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379df6a-8110-4141-9979-7aee64ff3259 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.378760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:17.421601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379df6a-8110-4141-9979-7aee64ff3259 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.429552 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5446-9c19-4777-901d-24616b65a4ec None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.462152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859bdb8-b250-4ee1-bd75-cdc82fe63a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.463838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859bdb8-b250-4ee1-bd75-cdc82fe63a38 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.464572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859bdb8-b250-4ee1-bd75-cdc82fe63a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.465133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859bdb8-b250-4ee1-bd75-cdc82fe63a38 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.466184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859bdb8-b250-4ee1-bd75-cdc82fe63a38 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.467279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17611fe1-f164-4211-b37e-5c924bde72b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.467955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611fe1-f164-4211-b37e-5c924bde72b6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.468235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611fe1-f164-4211-b37e-5c924bde72b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.468511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611fe1-f164-4211-b37e-5c924bde72b6 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.469016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859bdb8-b250-4ee1-bd75-cdc82fe63a38 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.469225 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17611fe1-f164-4211-b37e-5c924bde72b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:17.469533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17611fe1-f164-4211-b37e-5c924bde72b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.470883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17611fe1-f164-4211-b37e-5c924bde72b6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.481758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 464/919] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:17.482626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17611fe1-f164-4211-b37e-5c924bde72b6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0859bdb8-b250-4ee1-bd75-cdc82fe63a38 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:17.484257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:17.485209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:17.486034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:17.488536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 456/920] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:17.495013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859bdb8-b250-4ee1-bd75-cdc82fe63a38 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.541965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:17.600185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17611fe1-f164-4211-b37e-5c924bde72b6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.610685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859bdb8-b250-4ee1-bd75-cdc82fe63a38 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.639291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e54f0-a9c1-4600-8f83-e367b5b70b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.639967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e54f0-a9c1-4600-8f83-e367b5b70b81 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.640149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e54f0-a9c1-4600-8f83-e367b5b70b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.640412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e54f0-a9c1-4600-8f83-e367b5b70b81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.641195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e54f0-a9c1-4600-8f83-e367b5b70b81 None admin] RBAC: Adding query filter params (interface=public, service_id=463bca7a649543569c49de39123614e5, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:17.641508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e54f0-a9c1-4600-8f83-e367b5b70b81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.641851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:17.642943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e54f0-a9c1-4600-8f83-e367b5b70b81 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.651431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedca552-6c8a-4da4-ac7b-f8652c7d6d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.652453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedca552-6c8a-4da4-ac7b-f8652c7d6d11 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.660378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedca552-6c8a-4da4-ac7b-f8652c7d6d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.660513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 465/921] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/endpoints?service_id=463bca7a649543569c49de39123614e5&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:17.660599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedca552-6c8a-4da4-ac7b-f8652c7d6d11 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.660599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedca552-6c8a-4da4-ac7b-f8652c7d6d11 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:17.660735 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e54f0-a9c1-4600-8f83-e367b5b70b81 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.660813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedca552-6c8a-4da4-ac7b-f8652c7d6d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.660813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedca552-6c8a-4da4-ac7b-f8652c7d6d11 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.666999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 457/922] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:17.668197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedca552-6c8a-4da4-ac7b-f8652c7d6d11 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.758832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e54f0-a9c1-4600-8f83-e367b5b70b81 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.768715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:17.775600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedca552-6c8a-4da4-ac7b-f8652c7d6d11 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.795464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619a3c-74ce-4233-9154-67097884a0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.796118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619a3c-74ce-4233-9154-67097884a0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.796405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619a3c-74ce-4233-9154-67097884a0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.796676 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619a3c-74ce-4233-9154-67097884a0a4 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.797356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619a3c-74ce-4233-9154-67097884a0a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.798720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619a3c-74ce-4233-9154-67097884a0a4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.805171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 466/923] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:17.815034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04110086-1d7d-4e7c-9dd6-9ba7c84d12dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.816242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04110086-1d7d-4e7c-9dd6-9ba7c84d12dd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.816754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04110086-1d7d-4e7c-9dd6-9ba7c84d12dd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.817237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04110086-1d7d-4e7c-9dd6-9ba7c84d12dd None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.818216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04110086-1d7d-4e7c-9dd6-9ba7c84d12dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:17.818792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04110086-1d7d-4e7c-9dd6-9ba7c84d12dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.820442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04110086-1d7d-4e7c-9dd6-9ba7c84d12dd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.827344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 458/924] 10.222.0.13 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:17.833489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619a3c-74ce-4233-9154-67097884a0a4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.937335 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761a8e2-42a8-4c18-9651-a39f0198c2be None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.937833 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761a8e2-42a8-4c18-9651-a39f0198c2be None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.937833 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761a8e2-42a8-4c18-9651-a39f0198c2be None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.939550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 459/925] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:17.947578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55551899-5b9e-4b56-ba7a-0d11d9d5d559 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.948218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55551899-5b9e-4b56-ba7a-0d11d9d5d559 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.948703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55551899-5b9e-4b56-ba7a-0d11d9d5d559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.951380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619a3c-74ce-4233-9154-67097884a0a4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.968232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-55551899-5b9e-4b56-ba7a-0d11d9d5d559 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:17.969822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-55551899-5b9e-4b56-ba7a-0d11d9d5d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:17.999426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5a22-ab4e-42f4-92f8-f2a17018ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:18.000389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5a22-ab4e-42f4-92f8-f2a17018ed7a None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.000678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5a22-ab4e-42f4-92f8-f2a17018ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.000955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5a22-ab4e-42f4-92f8-f2a17018ed7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.002228 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e5a22-ab4e-42f4-92f8-f2a17018ed7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:18.003943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e5a22-ab4e-42f4-92f8-f2a17018ed7a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:18.035653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:18.054060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 460/926] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:18.077665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55551899-5b9e-4b56-ba7a-0d11d9d5d559 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:18.093347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 467/927] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:18.200740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55551899-5b9e-4b56-ba7a-0d11d9d5d559 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:18.253929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af56e3-6514-454b-bd52-2d39cb3f5c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:18.255080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af56e3-6514-454b-bd52-2d39cb3f5c50 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.255626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af56e3-6514-454b-bd52-2d39cb3f5c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.256107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af56e3-6514-454b-bd52-2d39cb3f5c50 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.256988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af56e3-6514-454b-bd52-2d39cb3f5c50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:18.259164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af56e3-6514-454b-bd52-2d39cb3f5c50 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-20af56e3-6514-454b-bd52-2d39cb3f5c50 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:18.272944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:18.273918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:18.275396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:18.279271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 461/928] 10.222.0.13 () {56 vars in 1132 bytes} [Thu Jun 2 09:55:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:18.281317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5a22-ab4e-42f4-92f8-f2a17018ed7a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:18.316133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:18.391915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5a22-ab4e-42f4-92f8-f2a17018ed7a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:18.426825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e1c0-0a27-44a4-8f2b-dd42d5af8190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:18.427573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e1c0-0a27-44a4-8f2b-dd42d5af8190 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.427859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e1c0-0a27-44a4-8f2b-dd42d5af8190 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.428133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e1c0-0a27-44a4-8f2b-dd42d5af8190 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.428887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e1c0-0a27-44a4-8f2b-dd42d5af8190 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:18.429206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e1c0-0a27-44a4-8f2b-dd42d5af8190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:18.431103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e1c0-0a27-44a4-8f2b-dd42d5af8190 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:18.436747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 468/929] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:18.442245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af56e3-6514-454b-bd52-2d39cb3f5c50 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:18.492112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:18.549406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af56e3-6514-454b-bd52-2d39cb3f5c50 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:18.553776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db7aef-25aa-44bb-82ad-6c60037f3238 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.554068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db7aef-25aa-44bb-82ad-6c60037f3238 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.554350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db7aef-25aa-44bb-82ad-6c60037f3238 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.556552 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 469/930] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:18.564551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656bbc8-e3c4-452f-bebc-0dd433a3a0d6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.564955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656bbc8-e3c4-452f-bebc-0dd433a3a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.565336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656bbc8-e3c4-452f-bebc-0dd433a3a0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.584216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8656bbc8-e3c4-452f-bebc-0dd433a3a0d6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:18.585568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8656bbc8-e3c4-452f-bebc-0dd433a3a0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:18.587563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad889b-6777-4115-b446-ee9bac2a8d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:18.588233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad889b-6777-4115-b446-ee9bac2a8d2d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.588515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad889b-6777-4115-b446-ee9bac2a8d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.588793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad889b-6777-4115-b446-ee9bac2a8d2d None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.589499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad889b-6777-4115-b446-ee9bac2a8d2d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:18.589807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad889b-6777-4115-b446-ee9bac2a8d2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:18.591178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad889b-6777-4115-b446-ee9bac2a8d2d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:18.596797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 462/931] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:18.601838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad889b-6777-4115-b446-ee9bac2a8d2d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:18.660446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 470/932] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:18.684147 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656bbc8-e3c4-452f-bebc-0dd433a3a0d6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:18.716121 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:18.718161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad889b-6777-4115-b446-ee9bac2a8d2d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:18.729497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:18.762510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b05537-cfbb-4a03-814b-779a43be012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:18.763294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b05537-cfbb-4a03-814b-779a43be012c None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.763682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b05537-cfbb-4a03-814b-779a43be012c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.764059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b05537-cfbb-4a03-814b-779a43be012c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.765273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b05537-cfbb-4a03-814b-779a43be012c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:18.767405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b05537-cfbb-4a03-814b-779a43be012c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:18.801615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656bbc8-e3c4-452f-bebc-0dd433a3a0d6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:18.836727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4e2f3-63f4-4a26-9883-a976fa436443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:18.837537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4e2f3-63f4-4a26-9883-a976fa436443 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.837821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4e2f3-63f4-4a26-9883-a976fa436443 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.838096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4e2f3-63f4-4a26-9883-a976fa436443 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.848761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4e2f3-63f4-4a26-9883-a976fa436443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7ad4e2f3-63f4-4a26-9883-a976fa436443 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:18.857604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:18.858559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:18.859434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:18.863394 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 471/933] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:18.864632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4e2f3-63f4-4a26-9883-a976fa436443 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:18.917158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 463/934] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:18.968942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:18.991476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4e2f3-63f4-4a26-9883-a976fa436443 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:19.041989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1b20d-9e4b-4717-888e-08c773cc66b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:19.042683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1b20d-9e4b-4717-888e-08c773cc66b7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.042967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1b20d-9e4b-4717-888e-08c773cc66b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.043274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1b20d-9e4b-4717-888e-08c773cc66b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.044097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1b20d-9e4b-4717-888e-08c773cc66b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:19.044411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1b20d-9e4b-4717-888e-08c773cc66b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:19.045810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1b20d-9e4b-4717-888e-08c773cc66b7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:19.056081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 472/935] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:19.062013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b05537-cfbb-4a03-814b-779a43be012c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:19.178019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b05537-cfbb-4a03-814b-779a43be012c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:19.212763 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0b514-2744-4b2f-9841-0dc0bc0fe372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:19.213563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0b514-2744-4b2f-9841-0dc0bc0fe372 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.213842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0b514-2744-4b2f-9841-0dc0bc0fe372 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.214113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0b514-2744-4b2f-9841-0dc0bc0fe372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.225947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0b514-2744-4b2f-9841-0dc0bc0fe372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:19.228074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0b514-2744-4b2f-9841-0dc0bc0fe372 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2bb0b514-2744-4b2f-9841-0dc0bc0fe372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:19.244976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:19.245932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:19.246840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:19.246840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:19.246840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:19.246840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:19.246840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 464/936] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:19.251726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1b20d-9e4b-4717-888e-08c773cc66b7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:19.357153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1b20d-9e4b-4717-888e-08c773cc66b7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:19.392302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b491f1e-971f-4205-a293-5dac7ac19d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:19.393021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b491f1e-971f-4205-a293-5dac7ac19d9f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.393305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b491f1e-971f-4205-a293-5dac7ac19d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.393580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b491f1e-971f-4205-a293-5dac7ac19d9f None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.394302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b491f1e-971f-4205-a293-5dac7ac19d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:19.394610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b491f1e-971f-4205-a293-5dac7ac19d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:19.396018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b491f1e-971f-4205-a293-5dac7ac19d9f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:19.406304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:19.410119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 473/937] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:19.415960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0b514-2744-4b2f-9841-0dc0bc0fe372 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:19.437185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:19.522761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0b514-2744-4b2f-9841-0dc0bc0fe372 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:19.560380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fdb6f-40c4-40ab-9eed-7b3ec9379244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:19.561197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fdb6f-40c4-40ab-9eed-7b3ec9379244 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.561480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fdb6f-40c4-40ab-9eed-7b3ec9379244 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.561756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fdb6f-40c4-40ab-9eed-7b3ec9379244 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.569904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fdb6f-40c4-40ab-9eed-7b3ec9379244 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:19.571414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fdb6f-40c4-40ab-9eed-7b3ec9379244 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-bb2fdb6f-40c4-40ab-9eed-7b3ec9379244 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:19.586081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:19.587073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:19.588031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 465/938] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:19.593620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b491f1e-971f-4205-a293-5dac7ac19d9f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:19.707764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b491f1e-971f-4205-a293-5dac7ac19d9f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:19.744302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33069d9b-492f-44d9-b69c-c9b3101442ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:19.744976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33069d9b-492f-44d9-b69c-c9b3101442ee None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.745256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33069d9b-492f-44d9-b69c-c9b3101442ee None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.745529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33069d9b-492f-44d9-b69c-c9b3101442ee None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.746376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33069d9b-492f-44d9-b69c-c9b3101442ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:19.746686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33069d9b-492f-44d9-b69c-c9b3101442ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:19.748138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33069d9b-492f-44d9-b69c-c9b3101442ee None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:19.766832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 474/939] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:19.772146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fdb6f-40c4-40ab-9eed-7b3ec9379244 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:19.862259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:19.884961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fdb6f-40c4-40ab-9eed-7b3ec9379244 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:19.920797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1871ad4-38a7-4c96-a150-cbd8181d5646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:19.921594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871ad4-38a7-4c96-a150-cbd8181d5646 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.921879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871ad4-38a7-4c96-a150-cbd8181d5646 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.922159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871ad4-38a7-4c96-a150-cbd8181d5646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.933399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1871ad4-38a7-4c96-a150-cbd8181d5646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:19.934841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1871ad4-38a7-4c96-a150-cbd8181d5646 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a1871ad4-38a7-4c96-a150-cbd8181d5646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:19.952064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:19.954078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:19.957527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:19.957527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:19.957527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:19.957527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:19.957527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 466/940] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:19.963168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33069d9b-492f-44d9-b69c-c9b3101442ee None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.022094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.065636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33069d9b-492f-44d9-b69c-c9b3101442ee None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.100761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360f415-f8be-47d5-b65a-d91aeda40376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.101432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360f415-f8be-47d5-b65a-d91aeda40376 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.101717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360f415-f8be-47d5-b65a-d91aeda40376 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.101994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360f415-f8be-47d5-b65a-d91aeda40376 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.103298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360f415-f8be-47d5-b65a-d91aeda40376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:20.103608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360f415-f8be-47d5-b65a-d91aeda40376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.104973 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360f415-f8be-47d5-b65a-d91aeda40376 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.116830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 475/941] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:20.122363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1871ad4-38a7-4c96-a150-cbd8181d5646 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.218578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907ff6-ae77-414b-911c-837c69f3109c None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.219227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907ff6-ae77-414b-911c-837c69f3109c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.219705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907ff6-ae77-414b-911c-837c69f3109c None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.223211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 476/942] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:20.226974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd249d-42a6-4384-b2f4-8b778ff7dbed None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.227541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd249d-42a6-4384-b2f4-8b778ff7dbed None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.227985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd249d-42a6-4384-b2f4-8b778ff7dbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.232352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1871ad4-38a7-4c96-a150-cbd8181d5646 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.245977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b2cd249d-42a6-4384-b2f4-8b778ff7dbed None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:20.247629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b2cd249d-42a6-4384-b2f4-8b778ff7dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:20.269724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.276273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d88e-10d9-47e5-af2c-5d5faa81252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.277400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d88e-10d9-47e5-af2c-5d5faa81252f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.277685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d88e-10d9-47e5-af2c-5d5faa81252f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.277964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d88e-10d9-47e5-af2c-5d5faa81252f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.290655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78d88e-10d9-47e5-af2c-5d5faa81252f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.293115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78d88e-10d9-47e5-af2c-5d5faa81252f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ae78d88e-10d9-47e5-af2c-5d5faa81252f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:20.313021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:20.313964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:20.315420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:20.315420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:20.315420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:20.315420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:20.315420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:20.315420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:20.315420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:20.315420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:20.315420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 467/943] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:20.320537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d88e-10d9-47e5-af2c-5d5faa81252f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.351203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 477/944] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:20.368810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd249d-42a6-4384-b2f4-8b778ff7dbed None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.420170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.424290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d88e-10d9-47e5-af2c-5d5faa81252f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.460129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46d25c-e7ab-4af6-a411-7235a3cdc2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.460877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d25c-e7ab-4af6-a411-7235a3cdc2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.461162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d25c-e7ab-4af6-a411-7235a3cdc2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.461493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d25c-e7ab-4af6-a411-7235a3cdc2c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.462780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46d25c-e7ab-4af6-a411-7235a3cdc2c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:20.463103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46d25c-e7ab-4af6-a411-7235a3cdc2c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.464702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46d25c-e7ab-4af6-a411-7235a3cdc2c9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.479590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd249d-42a6-4384-b2f4-8b778ff7dbed None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.483180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 468/945] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:20.483399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46d25c-e7ab-4af6-a411-7235a3cdc2c9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.516055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f837b-4adb-4c47-a0fc-7ea95db67ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.517236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f837b-4adb-4c47-a0fc-7ea95db67ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.517740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f837b-4adb-4c47-a0fc-7ea95db67ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.518221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f837b-4adb-4c47-a0fc-7ea95db67ef9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.519068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f837b-4adb-4c47-a0fc-7ea95db67ef9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.520659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f837b-4adb-4c47-a0fc-7ea95db67ef9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-624f837b-4adb-4c47-a0fc-7ea95db67ef9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:20.533513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:20.534485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:20.535357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:20.542934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 478/946] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:20.543500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.544551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f837b-4adb-4c47-a0fc-7ea95db67ef9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.593774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46d25c-e7ab-4af6-a411-7235a3cdc2c9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.630534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f88b5-26e3-4261-a59f-708c1eca0cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.631849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f88b5-26e3-4261-a59f-708c1eca0cc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.632133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f88b5-26e3-4261-a59f-708c1eca0cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.632407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f88b5-26e3-4261-a59f-708c1eca0cc4 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/b548998a91fb40519f794668c5c566af/roles/407071ed54014753a3e4d05e5b145946` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.635287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f88b5-26e3-4261-a59f-708c1eca0cc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=b548998a91fb40519f794668c5c566af, role_id=407071ed54014753a3e4d05e5b145946)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.636717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f88b5-26e3-4261-a59f-708c1eca0cc4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.652202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f837b-4adb-4c47-a0fc-7ea95db67ef9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.664815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.685127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bd82a-98c8-4cdf-879a-97524d042838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.685794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bd82a-98c8-4cdf-879a-97524d042838 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.686055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bd82a-98c8-4cdf-879a-97524d042838 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.686320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bd82a-98c8-4cdf-879a-97524d042838 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.687009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bd82a-98c8-4cdf-879a-97524d042838 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:20.687338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bd82a-98c8-4cdf-879a-97524d042838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.688685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bd82a-98c8-4cdf-879a-97524d042838 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.693236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 479/947] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:20.694419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d2704-79c1-422b-bf8a-ac0c01a0d714 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.694702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d2704-79c1-422b-bf8a-ac0c01a0d714 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.694975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d2704-79c1-422b-bf8a-ac0c01a0d714 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.697020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 480/948] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:20.700260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d2704-79c1-422b-bf8a-ac0c01a0d714 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.706871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 469/949] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:20 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/b548998a91fb40519f794668c5c566af/roles/407071ed54014753a3e4d05e5b145946 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:55:20.708391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4d33d-1129-4e0e-9d26-dc6a42e40eb9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.711353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4d33d-1129-4e0e-9d26-dc6a42e40eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.711353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4d33d-1129-4e0e-9d26-dc6a42e40eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.728037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-23e4d33d-1129-4e0e-9d26-dc6a42e40eb9 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:20.734711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-23e4d33d-1129-4e0e-9d26-dc6a42e40eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:20.807889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 470/950] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:20.825382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d2704-79c1-422b-bf8a-ac0c01a0d714 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.837386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4d33d-1129-4e0e-9d26-dc6a42e40eb9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.869666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd6fef-3eb3-4e65-bce8-d4db649d4a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.870745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd6fef-3eb3-4e65-bce8-d4db649d4a52 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.874072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd6fef-3eb3-4e65-bce8-d4db649d4a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.874072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd6fef-3eb3-4e65-bce8-d4db649d4a52 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.874072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd6fef-3eb3-4e65-bce8-d4db649d4a52 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:20.874072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd6fef-3eb3-4e65-bce8-d4db649d4a52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.874962 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd6fef-3eb3-4e65-bce8-d4db649d4a52 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.883025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 481/951] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:20.889204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.890780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd6fef-3eb3-4e65-bce8-d4db649d4a52 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.950059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.959664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4d33d-1129-4e0e-9d26-dc6a42e40eb9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.002521 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.004388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.004388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.004388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.004632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.005931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.007341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING keystone.server.flask.common [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 09:55:21.028057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd6fef-3eb3-4e65-bce8-d4db649d4a52 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.057467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.sql.core [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 09:55:21.057467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 09:55:21.057467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [parameters: {'id': '685711f0a10743be969e83776cd7d1b9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 09:55:21.057467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80295) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 09:55:21.064995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732afa1-8186-4b71-a71e-853de31d1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.065719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732afa1-8186-4b71-a71e-853de31d1ccd None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.066010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732afa1-8186-4b71-a71e-853de31d1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.066288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732afa1-8186-4b71-a71e-853de31d1ccd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 685711f0a10743be969e83776cd7d1b9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 685711f0a10743be969e83776cd7d1b9. Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:55:21.066598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 09:55:21.067408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application yield resource Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise self.value Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application session.commit() Jun 02 09:55:21.068767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.flush() Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application compat.raise_( Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 09:55:21.070084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 09:55:21.072112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:55:21.073205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [parameters: {'id': '685711f0a10743be969e83776cd7d1b9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.075035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:21.076574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:21.087645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:21.087645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 09:55:21.087645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 09:55:21.087645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:21.087645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:21.087645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 09:55:21.087645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 09:55:21.087645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 685711f0a10743be969e83776cd7d1b9. Jun 02 09:55:21.087645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.088175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732afa1-8186-4b71-a71e-853de31d1ccd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.088251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 471/952] 10.222.0.13 () {60 vars in 1140 bytes} [Thu Jun 2 09:55:20 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:21.088319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732afa1-8186-4b71-a71e-853de31d1ccd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.088386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.175558 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:21.184956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a604ac5-9051-49f5-b1cf-ecd9758a8719 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.186191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 482/953] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:21.241884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384e490-087f-43f1-b37a-edf5e8822a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.243609 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e490-087f-43f1-b37a-edf5e8822a9e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.244097 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e490-087f-43f1-b37a-edf5e8822a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.244801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e490-087f-43f1-b37a-edf5e8822a9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.253358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384e490-087f-43f1-b37a-edf5e8822a9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.255340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384e490-087f-43f1-b37a-edf5e8822a9e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1384e490-087f-43f1-b37a-edf5e8822a9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:21.276655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:21.277621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:21.279020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:21.279020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:21.279020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:21.279020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:21.279020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:21.279020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:21.279020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:21.279020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.279020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 472/954] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:21.284245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732afa1-8186-4b71-a71e-853de31d1ccd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.298234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd76636-1774-49ca-b60e-df7716e91b52 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.298603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd76636-1774-49ca-b60e-df7716e91b52 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.298777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd76636-1774-49ca-b60e-df7716e91b52 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.300506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 473/955] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:21.306703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54882be4-92eb-4a40-b0e4-8a17601f7432 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.307021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54882be4-92eb-4a40-b0e4-8a17601f7432 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.307869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54882be4-92eb-4a40-b0e4-8a17601f7432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.326653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-54882be4-92eb-4a40-b0e4-8a17601f7432 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:21.328243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-54882be4-92eb-4a40-b0e4-8a17601f7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:21.401318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:21.409468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732afa1-8186-4b71-a71e-853de31d1ccd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.424010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 474/956] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:21.445894 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54882be4-92eb-4a40-b0e4-8a17601f7432 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.453209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30e419-0717-44da-ab0a-aa37011cf7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.453909 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30e419-0717-44da-ab0a-aa37011cf7cd None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.454202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30e419-0717-44da-ab0a-aa37011cf7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.454460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30e419-0717-44da-ab0a-aa37011cf7cd None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.455267 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30e419-0717-44da-ab0a-aa37011cf7cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:21.455580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30e419-0717-44da-ab0a-aa37011cf7cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.457003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30e419-0717-44da-ab0a-aa37011cf7cd None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.475689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 483/957] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:21.548720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:21.569982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54882be4-92eb-4a40-b0e4-8a17601f7432 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.610999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991a5e1-8744-4eff-922f-50955e715256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.612126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991a5e1-8744-4eff-922f-50955e715256 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.612566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991a5e1-8744-4eff-922f-50955e715256 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.613002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991a5e1-8744-4eff-922f-50955e715256 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.613822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991a5e1-8744-4eff-922f-50955e715256 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.615470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991a5e1-8744-4eff-922f-50955e715256 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e991a5e1-8744-4eff-922f-50955e715256 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:21.628496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:21.629829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:21.630889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:21.634192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 475/958] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:21.640197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30e419-0717-44da-ab0a-aa37011cf7cd None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.747233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30e419-0717-44da-ab0a-aa37011cf7cd None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.784211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e98d0-96df-49c2-b0ef-1379709034cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.784877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e98d0-96df-49c2-b0ef-1379709034cb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.785158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e98d0-96df-49c2-b0ef-1379709034cb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.785430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e98d0-96df-49c2-b0ef-1379709034cb None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.786128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e98d0-96df-49c2-b0ef-1379709034cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:21.786429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e98d0-96df-49c2-b0ef-1379709034cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.787913 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e98d0-96df-49c2-b0ef-1379709034cb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.792861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 484/959] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:21.798493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991a5e1-8744-4eff-922f-50955e715256 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.905003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991a5e1-8744-4eff-922f-50955e715256 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.940562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d6e47-0f54-40bf-85c0-5d94a159e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.941633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d6e47-0f54-40bf-85c0-5d94a159e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.942119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d6e47-0f54-40bf-85c0-5d94a159e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.942691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d6e47-0f54-40bf-85c0-5d94a159e3d4 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.943615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d6e47-0f54-40bf-85c0-5d94a159e3d4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:21.944198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d6e47-0f54-40bf-85c0-5d94a159e3d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.946255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d6e47-0f54-40bf-85c0-5d94a159e3d4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.951615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 476/960] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:23.217521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b168-cb4b-47c1-8fce-fec75e636a75 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.217521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b168-cb4b-47c1-8fce-fec75e636a75 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.217521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b168-cb4b-47c1-8fce-fec75e636a75 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.218647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 485/961] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:23.224566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344dc8b-2db3-411a-8847-53d34ab56ef5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.225394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344dc8b-2db3-411a-8847-53d34ab56ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.225872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344dc8b-2db3-411a-8847-53d34ab56ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.243521 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2344dc8b-2db3-411a-8847-53d34ab56ef5 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:23.245018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2344dc8b-2db3-411a-8847-53d34ab56ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:23.248699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:23.331207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 477/962] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:23.352115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b168-cb4b-47c1-8fce-fec75e636a75 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.375172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:23.462470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b168-cb4b-47c1-8fce-fec75e636a75 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.498630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb318a-0438-456f-bac6-4eadbeab98c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.499518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb318a-0438-456f-bac6-4eadbeab98c4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.499805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb318a-0438-456f-bac6-4eadbeab98c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.500074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb318a-0438-456f-bac6-4eadbeab98c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.510985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb318a-0438-456f-bac6-4eadbeab98c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f2fb318a-0438-456f-bac6-4eadbeab98c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:23.519156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:23.520089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:23.520928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:23.525886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 486/963] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:23.527277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344dc8b-2db3-411a-8847-53d34ab56ef5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.628710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344dc8b-2db3-411a-8847-53d34ab56ef5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.666673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badace30-cd84-4c59-9152-2e258ff5cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.667391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badace30-cd84-4c59-9152-2e258ff5cf23 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.667677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badace30-cd84-4c59-9152-2e258ff5cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.667952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badace30-cd84-4c59-9152-2e258ff5cf23 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.668707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badace30-cd84-4c59-9152-2e258ff5cf23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:23.669013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badace30-cd84-4c59-9152-2e258ff5cf23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.670400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badace30-cd84-4c59-9152-2e258ff5cf23 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.684772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 478/964] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:23.686803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb318a-0438-456f-bac6-4eadbeab98c4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.726507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ef5b8-1004-4f3d-893d-2e90c29932b6 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.726870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ef5b8-1004-4f3d-893d-2e90c29932b6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.727132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ef5b8-1004-4f3d-893d-2e90c29932b6 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.728617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 479/965] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:23.733799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531477-9e2d-48e8-b4f0-26715ece0d2a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.734080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531477-9e2d-48e8-b4f0-26715ece0d2a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.734354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531477-9e2d-48e8-b4f0-26715ece0d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.740742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:23.763478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-31531477-9e2d-48e8-b4f0-26715ece0d2a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:23.763478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-31531477-9e2d-48e8-b4f0-26715ece0d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:23.789360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:23.809330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb318a-0438-456f-bac6-4eadbeab98c4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.825645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 480/966] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:23.852115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531477-9e2d-48e8-b4f0-26715ece0d2a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.854259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f788-add1-4135-a0aa-f2f10a38230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.855466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f788-add1-4135-a0aa-f2f10a38230d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.855953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f788-add1-4135-a0aa-f2f10a38230d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.856443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f788-add1-4135-a0aa-f2f10a38230d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.869076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0f788-add1-4135-a0aa-f2f10a38230d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.870886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0f788-add1-4135-a0aa-f2f10a38230d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-23e0f788-add1-4135-a0aa-f2f10a38230d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:23.889612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:23.890526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:23.891874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:23.891874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:23.891874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:23.891874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:23.893831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 487/967] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:23.899601 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f788-add1-4135-a0aa-f2f10a38230d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.959351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531477-9e2d-48e8-b4f0-26715ece0d2a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.995878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:24.000942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858fd8-1786-427b-8646-46027f08a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.001773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858fd8-1786-427b-8646-46027f08a153 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.002054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858fd8-1786-427b-8646-46027f08a153 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.002327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858fd8-1786-427b-8646-46027f08a153 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.002981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9858fd8-1786-427b-8646-46027f08a153 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.004449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9858fd8-1786-427b-8646-46027f08a153 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.013819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f788-add1-4135-a0aa-f2f10a38230d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a9858fd8-1786-427b-8646-46027f08a153 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:24.016886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:24.017965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:24.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 481/968] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:24.023366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f529c-dbe7-43b1-89b9-c86781a4ee5f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.023366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f529c-dbe7-43b1-89b9-c86781a4ee5f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.023366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f529c-dbe7-43b1-89b9-c86781a4ee5f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.023366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 482/969] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:24.023838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f529c-dbe7-43b1-89b9-c86781a4ee5f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.051811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:24.056997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9bfca-ea71-4e5c-b64f-fa7a669fb74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.066220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9bfca-ea71-4e5c-b64f-fa7a669fb74b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.066220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9bfca-ea71-4e5c-b64f-fa7a669fb74b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.066220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9bfca-ea71-4e5c-b64f-fa7a669fb74b None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.066220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9bfca-ea71-4e5c-b64f-fa7a669fb74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:24.066220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9bfca-ea71-4e5c-b64f-fa7a669fb74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.066220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9bfca-ea71-4e5c-b64f-fa7a669fb74b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.078510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 488/970] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:24.078510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d20c-193d-4d19-8e8f-b42756a8c89c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.078510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d20c-193d-4d19-8e8f-b42756a8c89c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.078510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d20c-193d-4d19-8e8f-b42756a8c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.093951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7164d20c-193d-4d19-8e8f-b42756a8c89c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:24.095174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7164d20c-193d-4d19-8e8f-b42756a8c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:24.135170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f529c-dbe7-43b1-89b9-c86781a4ee5f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.161650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 489/971] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:24.162487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164d20c-193d-4d19-8e8f-b42756a8c89c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.176278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42a9d0-a868-4d1b-9e18-e8d7775ff611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.177216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42a9d0-a868-4d1b-9e18-e8d7775ff611 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.177679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42a9d0-a868-4d1b-9e18-e8d7775ff611 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.178274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42a9d0-a868-4d1b-9e18-e8d7775ff611 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.178991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42a9d0-a868-4d1b-9e18-e8d7775ff611 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:24.179329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42a9d0-a868-4d1b-9e18-e8d7775ff611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.181370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42a9d0-a868-4d1b-9e18-e8d7775ff611 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.187076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 483/972] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:24.191242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42a9d0-a868-4d1b-9e18-e8d7775ff611 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.256205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:24.284845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164d20c-193d-4d19-8e8f-b42756a8c89c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.303614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42a9d0-a868-4d1b-9e18-e8d7775ff611 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.309896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:24.321360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523380b3-4049-4aed-826a-aaf2e98d6e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.322175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523380b3-4049-4aed-826a-aaf2e98d6e8a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.322456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523380b3-4049-4aed-826a-aaf2e98d6e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.322728 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523380b3-4049-4aed-826a-aaf2e98d6e8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.329752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523380b3-4049-4aed-826a-aaf2e98d6e8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.331211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523380b3-4049-4aed-826a-aaf2e98d6e8a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.337774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab03e2-9801-49b5-bd0f-94baf166dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.338444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab03e2-9801-49b5-bd0f-94baf166dea3 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.338721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab03e2-9801-49b5-bd0f-94baf166dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.338994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab03e2-9801-49b5-bd0f-94baf166dea3 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.339710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab03e2-9801-49b5-bd0f-94baf166dea3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.341367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab03e2-9801-49b5-bd0f-94baf166dea3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-523380b3-4049-4aed-826a-aaf2e98d6e8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:24.347023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:24.348141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 490/973] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:55:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:24.349221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523380b3-4049-4aed-826a-aaf2e98d6e8a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.408244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.sql.core [None req-86ab03e2-9801-49b5-bd0f-94baf166dea3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 09:55:24.408244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 09:55:24.408244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [parameters: {'user_id': '68657881ea984b2a86ccc3eceb20c3bc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 09:55:24.408244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80295) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-86ab03e2-9801-49b5-bd0f-94baf166dea3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 02 09:55:24.416140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:55:24.417156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application yield resource Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise self.value Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application session.commit() Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 09:55:24.418117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.session.flush() Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application compat.raise_( Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 09:55:24.419038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:55:24.419987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application result.read() Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:55:24.420867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [parameters: {'user_id': '68657881ea984b2a86ccc3eceb20c3bc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:24.421750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 09:55:24.422566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 484/974] 10.222.0.13 () {60 vars in 1131 bytes} [Thu Jun 2 09:55:24 2022] POST /identity/v3/users => generated 160 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa66e6-5801-4ce9-bd32-9124edfb5c0e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa66e6-5801-4ce9-bd32-9124edfb5c0e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.423662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa66e6-5801-4ce9-bd32-9124edfb5c0e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.424225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 485/975] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:24.424850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa66e6-5801-4ce9-bd32-9124edfb5c0e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.454276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523380b3-4049-4aed-826a-aaf2e98d6e8a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.489222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42b36-86f4-4e23-9c11-39584b3bd341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.489907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42b36-86f4-4e23-9c11-39584b3bd341 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.490188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42b36-86f4-4e23-9c11-39584b3bd341 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.490460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42b36-86f4-4e23-9c11-39584b3bd341 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.491194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b42b36-86f4-4e23-9c11-39584b3bd341 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:24.491500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b42b36-86f4-4e23-9c11-39584b3bd341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.492860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b42b36-86f4-4e23-9c11-39584b3bd341 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.497570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 491/976] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:24.498342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42b36-86f4-4e23-9c11-39584b3bd341 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.528469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa66e6-5801-4ce9-bd32-9124edfb5c0e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.543551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:24.551116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:24.563003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57ccd7-8ee7-462c-96d6-2aad4e1e4e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.563705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57ccd7-8ee7-462c-96d6-2aad4e1e4e66 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.563987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57ccd7-8ee7-462c-96d6-2aad4e1e4e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.564388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57ccd7-8ee7-462c-96d6-2aad4e1e4e66 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.565221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57ccd7-8ee7-462c-96d6-2aad4e1e4e66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:24.565535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57ccd7-8ee7-462c-96d6-2aad4e1e4e66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.567206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57ccd7-8ee7-462c-96d6-2aad4e1e4e66 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.584692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 486/977] 10.222.0.13 () {56 vars in 1149 bytes} [Thu Jun 2 09:55:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:24.586413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7600f7-5478-444f-b328-5de27d464237 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.586702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7600f7-5478-444f-b328-5de27d464237 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.586974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7600f7-5478-444f-b328-5de27d464237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.599512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42b36-86f4-4e23-9c11-39584b3bd341 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.604510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ae7600f7-5478-444f-b328-5de27d464237 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:24.606025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ae7600f7-5478-444f-b328-5de27d464237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:24.635035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec565f-2910-47a1-8a41-c732beb6db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.635811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec565f-2910-47a1-8a41-c732beb6db0e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.636091 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec565f-2910-47a1-8a41-c732beb6db0e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.636358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec565f-2910-47a1-8a41-c732beb6db0e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.643319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec565f-2910-47a1-8a41-c732beb6db0e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.644744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec565f-2910-47a1-8a41-c732beb6db0e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-44ec565f-2910-47a1-8a41-c732beb6db0e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:24.659484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:24.660512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 492/978] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:24.661460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec565f-2910-47a1-8a41-c732beb6db0e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.675030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 487/979] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:24.675897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7600f7-5478-444f-b328-5de27d464237 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.772416 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7600f7-5478-444f-b328-5de27d464237 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.778080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec565f-2910-47a1-8a41-c732beb6db0e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.783343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:24.785214 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:24.805410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119ca7e-e96b-44ed-8cef-3a8b76bf4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.806049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119ca7e-e96b-44ed-8cef-3a8b76bf4fde None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.806329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119ca7e-e96b-44ed-8cef-3a8b76bf4fde None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.806595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119ca7e-e96b-44ed-8cef-3a8b76bf4fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.811122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576e90-0731-4bbe-8645-f566500c4725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.811776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576e90-0731-4bbe-8645-f566500c4725 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.812058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576e90-0731-4bbe-8645-f566500c4725 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.812332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576e90-0731-4bbe-8645-f566500c4725 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.813166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2576e90-0731-4bbe-8645-f566500c4725 None admin] RBAC: Adding query filter params (interface=admin, service_id=463bca7a649543569c49de39123614e5, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:24.813478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2576e90-0731-4bbe-8645-f566500c4725 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.814833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2576e90-0731-4bbe-8645-f566500c4725 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.819824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 493/980] 10.222.0.13 () {56 vars in 1249 bytes} [Thu Jun 2 09:55:24 2022] GET /identity/v3/endpoints?service_id=463bca7a649543569c49de39123614e5&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:24.824166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576e90-0731-4bbe-8645-f566500c4725 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.875432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119ca7e-e96b-44ed-8cef-3a8b76bf4fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.876868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119ca7e-e96b-44ed-8cef-3a8b76bf4fde None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.919787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576e90-0731-4bbe-8645-f566500c4725 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:24.954035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ea188-354f-4d70-838b-bf1b081a85f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:24.954701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ea188-354f-4d70-838b-bf1b081a85f0 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:24.954985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ea188-354f-4d70-838b-bf1b081a85f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:24.955295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ea188-354f-4d70-838b-bf1b081a85f0 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:24.956087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ea188-354f-4d70-838b-bf1b081a85f0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:24.956395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ea188-354f-4d70-838b-bf1b081a85f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:24.957798 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ea188-354f-4d70-838b-bf1b081a85f0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:24.975153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 488/981] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:24.975968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119ca7e-e96b-44ed-8cef-3a8b76bf4fde None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:24.987596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:24.992719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 494/982] 10.222.0.13 () {56 vars in 1101 bytes} [Thu Jun 2 09:55:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:24.993546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ea188-354f-4d70-838b-bf1b081a85f0 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:25.027900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:25.092975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119ca7e-e96b-44ed-8cef-3a8b76bf4fde None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:25.128438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ea188-354f-4d70-838b-bf1b081a85f0 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:25.130782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c807e1e-0a29-47be-869a-e883dac7b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:25.131504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807e1e-0a29-47be-869a-e883dac7b10b None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.131785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807e1e-0a29-47be-869a-e883dac7b10b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.132063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807e1e-0a29-47be-869a-e883dac7b10b None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.133358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c807e1e-0a29-47be-869a-e883dac7b10b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:25.134749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c807e1e-0a29-47be-869a-e883dac7b10b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:25.168143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a85811-20d6-4a57-bd29-b4487c26abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:25.168822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a85811-20d6-4a57-bd29-b4487c26abbe None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.169100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a85811-20d6-4a57-bd29-b4487c26abbe None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.169371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a85811-20d6-4a57-bd29-b4487c26abbe None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.170058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a85811-20d6-4a57-bd29-b4487c26abbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:25.171469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a85811-20d6-4a57-bd29-b4487c26abbe None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:25.177976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 495/983] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:24 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:25.178795 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a85811-20d6-4a57-bd29-b4487c26abbe None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:25.213404 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 489/984] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:24 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:25.313070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:25.319961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a85811-20d6-4a57-bd29-b4487c26abbe None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:25.370508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496937bf-67d7-44cc-ac5d-8a48fabf3071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:25.371274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496937bf-67d7-44cc-ac5d-8a48fabf3071 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.371559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496937bf-67d7-44cc-ac5d-8a48fabf3071 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.371833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496937bf-67d7-44cc-ac5d-8a48fabf3071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.384271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496937bf-67d7-44cc-ac5d-8a48fabf3071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:25.385756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496937bf-67d7-44cc-ac5d-8a48fabf3071 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-496937bf-67d7-44cc-ac5d-8a48fabf3071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:25.405116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:25.406101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:25.407029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:25.407029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:25.407029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:25.407029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:25.411443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 496/985] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:25.412389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c807e1e-0a29-47be-869a-e883dac7b10b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:25.488099 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:25.519784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c807e1e-0a29-47be-869a-e883dac7b10b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:25.555427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aec42-dd07-4beb-82de-a8c17a5047f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:25.556098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aec42-dd07-4beb-82de-a8c17a5047f8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.556379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aec42-dd07-4beb-82de-a8c17a5047f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.556656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aec42-dd07-4beb-82de-a8c17a5047f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.557378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aec42-dd07-4beb-82de-a8c17a5047f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:25.557682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aec42-dd07-4beb-82de-a8c17a5047f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:25.559032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aec42-dd07-4beb-82de-a8c17a5047f8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:25.571659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 490/986] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:25.577347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496937bf-67d7-44cc-ac5d-8a48fabf3071 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:25.677931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496937bf-67d7-44cc-ac5d-8a48fabf3071 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:25.711828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee239-c070-484b-8472-7c886ec70ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:25.712623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee239-c070-484b-8472-7c886ec70ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.712900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee239-c070-484b-8472-7c886ec70ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.713170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee239-c070-484b-8472-7c886ec70ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.720808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ee239-c070-484b-8472-7c886ec70ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:25.722228 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ee239-c070-484b-8472-7c886ec70ce8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:25.724769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-972ee239-c070-484b-8472-7c886ec70ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:25.737142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:25.741609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:25.743692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:25.743692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:25.743692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:25.743692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:25.743692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:25.743692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:25.743692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:25.743692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:25.743692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 497/987] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:25.745387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aec42-dd07-4beb-82de-a8c17a5047f8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:25.847546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aec42-dd07-4beb-82de-a8c17a5047f8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:25.876125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:25.882324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa37539-4cdb-48e3-99ab-fba05f24c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:25.883016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa37539-4cdb-48e3-99ab-fba05f24c6cf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.883385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa37539-4cdb-48e3-99ab-fba05f24c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.883603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa37539-4cdb-48e3-99ab-fba05f24c6cf None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.884378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa37539-4cdb-48e3-99ab-fba05f24c6cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:25.884691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa37539-4cdb-48e3-99ab-fba05f24c6cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:25.886095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa37539-4cdb-48e3-99ab-fba05f24c6cf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:25.902889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 491/988] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:25.904359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee239-c070-484b-8472-7c886ec70ce8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.006812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee239-c070-484b-8472-7c886ec70ce8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.041269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad98be-bc29-426e-a7bc-7dc6cf0fe07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.041927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad98be-bc29-426e-a7bc-7dc6cf0fe07b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.042203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad98be-bc29-426e-a7bc-7dc6cf0fe07b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.042495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad98be-bc29-426e-a7bc-7dc6cf0fe07b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.043350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad98be-bc29-426e-a7bc-7dc6cf0fe07b None admin] RBAC: Adding query filter params (role.id=407071ed54014753a3e4d05e5b145946, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=b548998a91fb40519f794668c5c566af) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:26.043660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad98be-bc29-426e-a7bc-7dc6cf0fe07b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:26.045064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad98be-bc29-426e-a7bc-7dc6cf0fe07b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:26.052107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 498/989] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:25 2022] GET /identity/v3/role_assignments?user.id=b548998a91fb40519f794668c5c566af&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=407071ed54014753a3e4d05e5b145946 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:27.458068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ecbe2-5fb3-48a3-94d2-99e67e61c1eb None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.458606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ecbe2-5fb3-48a3-94d2-99e67e61c1eb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.458606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ecbe2-5fb3-48a3-94d2-99e67e61c1eb None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.460157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 492/990] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:27.466161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192779e0-f04b-4dba-b8f8-64171d524d03 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.466585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192779e0-f04b-4dba-b8f8-64171d524d03 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.466749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192779e0-f04b-4dba-b8f8-64171d524d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.484301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-192779e0-f04b-4dba-b8f8-64171d524d03 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:27.485488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-192779e0-f04b-4dba-b8f8-64171d524d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:27.535514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a518f-58ec-475c-ad5a-6d7e7a48254e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.535798 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a518f-58ec-475c-ad5a-6d7e7a48254e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.536074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a518f-58ec-475c-ad5a-6d7e7a48254e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.537685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 493/991] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:27.542872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261651f8-11bf-42ee-87ab-37e83986a9be None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.543197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261651f8-11bf-42ee-87ab-37e83986a9be None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.543477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261651f8-11bf-42ee-87ab-37e83986a9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.545810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:27.554889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 499/992] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:27.560583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-261651f8-11bf-42ee-87ab-37e83986a9be None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:27.561760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-261651f8-11bf-42ee-87ab-37e83986a9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:27.577818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192779e0-f04b-4dba-b8f8-64171d524d03 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.636409 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 494/993] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:27.659060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261651f8-11bf-42ee-87ab-37e83986a9be None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.687552 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192779e0-f04b-4dba-b8f8-64171d524d03 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.723982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297791-82aa-4572-870e-99b255333476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.724792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297791-82aa-4572-870e-99b255333476 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.725068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297791-82aa-4572-870e-99b255333476 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.725342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297791-82aa-4572-870e-99b255333476 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.725985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b297791-82aa-4572-870e-99b255333476 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.727430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b297791-82aa-4572-870e-99b255333476 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2b297791-82aa-4572-870e-99b255333476 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:27.739907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:27.740908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:27.742162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 500/994] 10.222.0.13 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:27.747655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297791-82aa-4572-870e-99b255333476 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.767047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261651f8-11bf-42ee-87ab-37e83986a9be None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.790654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:27.805508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419991a4-ad5d-471b-9c8b-2416c3e560ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.806398 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419991a4-ad5d-471b-9c8b-2416c3e560ba None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.806686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419991a4-ad5d-471b-9c8b-2416c3e560ba None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.806958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419991a4-ad5d-471b-9c8b-2416c3e560ba None admin] PATH_INFO: `/v3/services/compute` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.807648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419991a4-ad5d-471b-9c8b-2416c3e560ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.807972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:27.809117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419991a4-ad5d-471b-9c8b-2416c3e560ba None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-419991a4-ad5d-471b-9c8b-2416c3e560ba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:27.822405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:27.823658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:27.824552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:27.828236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 495/995] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:27.833700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419991a4-ad5d-471b-9c8b-2416c3e560ba None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.857006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297791-82aa-4572-870e-99b255333476 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.893183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ab456-4ba6-46b1-9362-0c594f11036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.893848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ab456-4ba6-46b1-9362-0c594f11036f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.894127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ab456-4ba6-46b1-9362-0c594f11036f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.894397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ab456-4ba6-46b1-9362-0c594f11036f None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.895118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ab456-4ba6-46b1-9362-0c594f11036f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:27.895423 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ab456-4ba6-46b1-9362-0c594f11036f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.896784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ab456-4ba6-46b1-9362-0c594f11036f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.902382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 501/996] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:27.907878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ab456-4ba6-46b1-9362-0c594f11036f None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.938887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419991a4-ad5d-471b-9c8b-2416c3e560ba None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.981451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da547141-87e4-499f-bd9c-a25f0e73f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.982145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da547141-87e4-499f-bd9c-a25f0e73f2ee None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.982431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da547141-87e4-499f-bd9c-a25f0e73f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.982971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da547141-87e4-499f-bd9c-a25f0e73f2ee None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.984635 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da547141-87e4-499f-bd9c-a25f0e73f2ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:27.984949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da547141-87e4-499f-bd9c-a25f0e73f2ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.986360 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da547141-87e4-499f-bd9c-a25f0e73f2ee None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.998172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 496/997] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:27.999539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da547141-87e4-499f-bd9c-a25f0e73f2ee None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:28.015449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ab456-4ba6-46b1-9362-0c594f11036f None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.043014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:28.054145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:28.059047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc188c68-4911-4d75-9f20-b747677fe795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.059752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc188c68-4911-4d75-9f20-b747677fe795 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.060309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc188c68-4911-4d75-9f20-b747677fe795 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.060584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc188c68-4911-4d75-9f20-b747677fe795 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.061290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc188c68-4911-4d75-9f20-b747677fe795 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:28.061738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc188c68-4911-4d75-9f20-b747677fe795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.063742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc188c68-4911-4d75-9f20-b747677fe795 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.070742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 502/998] 10.222.0.13 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:28.076362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc188c68-4911-4d75-9f20-b747677fe795 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:28.113329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da547141-87e4-499f-bd9c-a25f0e73f2ee None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.148704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b8f4-6d02-4c1e-b803-5a9d3cca7798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.149368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b8f4-6d02-4c1e-b803-5a9d3cca7798 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.149639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b8f4-6d02-4c1e-b803-5a9d3cca7798 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.149911 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b8f4-6d02-4c1e-b803-5a9d3cca7798 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.150605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4b8f4-6d02-4c1e-b803-5a9d3cca7798 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:28.150905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4b8f4-6d02-4c1e-b803-5a9d3cca7798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.152508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4b8f4-6d02-4c1e-b803-5a9d3cca7798 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.157748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 497/999] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:28.163284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b8f4-6d02-4c1e-b803-5a9d3cca7798 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:28.183648 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc188c68-4911-4d75-9f20-b747677fe795 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.219869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e61b48-f0db-47dd-bcf8-dbb89db6ebfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.220897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e61b48-f0db-47dd-bcf8-dbb89db6ebfc None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.221404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e61b48-f0db-47dd-bcf8-dbb89db6ebfc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.221894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e61b48-f0db-47dd-bcf8-dbb89db6ebfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.222893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e61b48-f0db-47dd-bcf8-dbb89db6ebfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.224507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e61b48-f0db-47dd-bcf8-dbb89db6ebfc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.267157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b8f4-6d02-4c1e-b803-5a9d3cca7798 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.280011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:28.290784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 503/1000] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:28.309122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a52f0-300b-49c8-9348-e7583f039770 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.309476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a52f0-300b-49c8-9348-e7583f039770 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.309669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a52f0-300b-49c8-9348-e7583f039770 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.311272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 504/1001] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:28.316992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb55af-10e7-49e8-aa06-44cbbe666935 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.317343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb55af-10e7-49e8-aa06-44cbbe666935 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.317625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb55af-10e7-49e8-aa06-44cbbe666935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.318882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e82e71-f35d-45e8-b872-19160fe07ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.319585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e82e71-f35d-45e8-b872-19160fe07ddd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.319918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e82e71-f35d-45e8-b872-19160fe07ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.320690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e82e71-f35d-45e8-b872-19160fe07ddd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.321491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e82e71-f35d-45e8-b872-19160fe07ddd None admin] RBAC: Adding query filter params (interface=public, service_id=d5d72d2f89514068b8de9fcf45140df9, region_id=RegionOne) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:28.321799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e82e71-f35d-45e8-b872-19160fe07ddd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.323209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e82e71-f35d-45e8-b872-19160fe07ddd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.335216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 498/1002] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:28 2022] GET /identity/v3/endpoints?service_id=d5d72d2f89514068b8de9fcf45140df9&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:28.337271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-deeb55af-10e7-49e8-aa06-44cbbe666935 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:28.337421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e82e71-f35d-45e8-b872-19160fe07ddd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:28.338508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-deeb55af-10e7-49e8-aa06-44cbbe666935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:28.392676 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:28.426206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 505/1003] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:28.443563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb55af-10e7-49e8-aa06-44cbbe666935 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:28.461151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e82e71-f35d-45e8-b872-19160fe07ddd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.501372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1986fa-eaa5-424a-9a98-572f86ea221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.502043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1986fa-eaa5-424a-9a98-572f86ea221c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.502328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1986fa-eaa5-424a-9a98-572f86ea221c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.502603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1986fa-eaa5-424a-9a98-572f86ea221c None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.503320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1986fa-eaa5-424a-9a98-572f86ea221c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.504684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1986fa-eaa5-424a-9a98-572f86ea221c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.512850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 499/1004] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:28 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:28.559986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb55af-10e7-49e8-aa06-44cbbe666935 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.597653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b820b82-50f1-4808-a4bc-34b31a6dce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.598913 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b820b82-50f1-4808-a4bc-34b31a6dce8b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.599442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b820b82-50f1-4808-a4bc-34b31a6dce8b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.599944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b820b82-50f1-4808-a4bc-34b31a6dce8b None admin] PATH_INFO: `/v3/services/image` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.600812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b820b82-50f1-4808-a4bc-34b31a6dce8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.602943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b820b82-50f1-4808-a4bc-34b31a6dce8b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-2b820b82-50f1-4808-a4bc-34b31a6dce8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:28.615750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:28.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:28.618276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:28.620849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 506/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Jun 2 09:55:28 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:28.627085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1986fa-eaa5-424a-9a98-572f86ea221c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:28.665850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:28.736720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1986fa-eaa5-424a-9a98-572f86ea221c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.772237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bf02f-1f54-400b-a620-fd28cdffe0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.773453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf02f-1f54-400b-a620-fd28cdffe0cd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.773742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf02f-1f54-400b-a620-fd28cdffe0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.774012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf02f-1f54-400b-a620-fd28cdffe0cd None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.774703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bf02f-1f54-400b-a620-fd28cdffe0cd None admin] RBAC: Adding query filter params (name=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:28.775066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bf02f-1f54-400b-a620-fd28cdffe0cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.776427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bf02f-1f54-400b-a620-fd28cdffe0cd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.782089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 500/1006] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:28.788325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b820b82-50f1-4808-a4bc-34b31a6dce8b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:28.832790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:28.893827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b820b82-50f1-4808-a4bc-34b31a6dce8b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.929029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416c18e-2a96-4941-8585-220b8d0c31f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.929742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416c18e-2a96-4941-8585-220b8d0c31f6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.930024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416c18e-2a96-4941-8585-220b8d0c31f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.930298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416c18e-2a96-4941-8585-220b8d0c31f6 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.930993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416c18e-2a96-4941-8585-220b8d0c31f6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:28.931328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416c18e-2a96-4941-8585-220b8d0c31f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.932690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416c18e-2a96-4941-8585-220b8d0c31f6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.937437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 507/1007] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:30.597698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d175e3e-e6cd-40bb-a42a-a721a28502f1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.598220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d175e3e-e6cd-40bb-a42a-a721a28502f1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.598220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d175e3e-e6cd-40bb-a42a-a721a28502f1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.599907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 501/1008] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:30.604977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b6ca-603f-43e9-a52f-a7ba96c8b567 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.605404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b6ca-603f-43e9-a52f-a7ba96c8b567 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.605545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b6ca-603f-43e9-a52f-a7ba96c8b567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.623472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-05c9b6ca-603f-43e9-a52f-a7ba96c8b567 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:30.624654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-05c9b6ca-603f-43e9-a52f-a7ba96c8b567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:30.695872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 508/1009] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:30.719290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d175e3e-e6cd-40bb-a42a-a721a28502f1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:30.760412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc343a-6eea-4e82-a4d0-0bd5245c5217 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.760744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc343a-6eea-4e82-a4d0-0bd5245c5217 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.760960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc343a-6eea-4e82-a4d0-0bd5245c5217 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.762469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 509/1010] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:30.767342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5967c-e162-4a1e-bc33-2107127853c8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.767629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5967c-e162-4a1e-bc33-2107127853c8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.767918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5967c-e162-4a1e-bc33-2107127853c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.784617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-35c5967c-e162-4a1e-bc33-2107127853c8 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:30.785810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-35c5967c-e162-4a1e-bc33-2107127853c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:30.816268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:30.827283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:30.831134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d175e3e-e6cd-40bb-a42a-a721a28502f1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:30.863625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 510/1011] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:30.870494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879afc4-ef5f-4489-a567-27f3ece7f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:30.871211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879afc4-ef5f-4489-a567-27f3ece7f596 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.871493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879afc4-ef5f-4489-a567-27f3ece7f596 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.871764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879afc4-ef5f-4489-a567-27f3ece7f596 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.872997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879afc4-ef5f-4489-a567-27f3ece7f596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:30.874438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879afc4-ef5f-4489-a567-27f3ece7f596 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:30.876355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 502/1012] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:30.882408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5967c-e162-4a1e-bc33-2107127853c8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:30.890100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879afc4-ef5f-4489-a567-27f3ece7f596 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:30.988673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5967c-e162-4a1e-bc33-2107127853c8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:30.994349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879afc4-ef5f-4489-a567-27f3ece7f596 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.025828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3067dc3-654c-4411-886e-11832f76d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.026555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3067dc3-654c-4411-886e-11832f76d7d4 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.026899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3067dc3-654c-4411-886e-11832f76d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.027127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3067dc3-654c-4411-886e-11832f76d7d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.027869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3067dc3-654c-4411-886e-11832f76d7d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.029275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3067dc3-654c-4411-886e-11832f76d7d4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.030687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc88f16-a851-42be-a193-56f8cbd5b722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.031534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc88f16-a851-42be-a193-56f8cbd5b722 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.031819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc88f16-a851-42be-a193-56f8cbd5b722 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.032093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc88f16-a851-42be-a193-56f8cbd5b722 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.032736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc88f16-a851-42be-a193-56f8cbd5b722 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.034068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc88f16-a851-42be-a193-56f8cbd5b722 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-ccc88f16-a851-42be-a193-56f8cbd5b722 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:31.046625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:31.047901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:31.048746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 503/1013] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:31.053881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc88f16-a851-42be-a193-56f8cbd5b722 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.086544 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:31.123212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 511/1014] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:30 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:31.170538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc88f16-a851-42be-a193-56f8cbd5b722 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.179633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48043fa-8f70-4b35-98f7-cb13709a107f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.180654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48043fa-8f70-4b35-98f7-cb13709a107f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.181003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48043fa-8f70-4b35-98f7-cb13709a107f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.183264 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 512/1015] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:31.189215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a1d5-bf0e-4103-8641-a6556000219c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.189511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a1d5-bf0e-4103-8641-a6556000219c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.189788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a1d5-bf0e-4103-8641-a6556000219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.207169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9ca2a1d5-bf0e-4103-8641-a6556000219c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:31.208399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9ca2a1d5-bf0e-4103-8641-a6556000219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:31.212304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba8ab-8b21-4d19-8e5d-986f365f528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.212991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba8ab-8b21-4d19-8e5d-986f365f528e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.213274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba8ab-8b21-4d19-8e5d-986f365f528e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.213554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba8ab-8b21-4d19-8e5d-986f365f528e None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.214273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceba8ab-8b21-4d19-8e5d-986f365f528e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:31.214584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceba8ab-8b21-4d19-8e5d-986f365f528e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.216298 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceba8ab-8b21-4d19-8e5d-986f365f528e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.222044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:31.227308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 504/1016] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:31.229319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba8ab-8b21-4d19-8e5d-986f365f528e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.286317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 513/1017] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:31.311081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a1d5-bf0e-4103-8641-a6556000219c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.347424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:31.353778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba8ab-8b21-4d19-8e5d-986f365f528e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.390859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22da29-d1db-41c5-92af-5275e829d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.391572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22da29-d1db-41c5-92af-5275e829d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.391855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22da29-d1db-41c5-92af-5275e829d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.392126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22da29-d1db-41c5-92af-5275e829d4f6 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.392829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22da29-d1db-41c5-92af-5275e829d4f6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:31.393132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22da29-d1db-41c5-92af-5275e829d4f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.394477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22da29-d1db-41c5-92af-5275e829d4f6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.403464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 505/1018] 10.222.0.13 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:31.405714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22da29-d1db-41c5-92af-5275e829d4f6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.429196 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a1d5-bf0e-4103-8641-a6556000219c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.469345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435953d2-a15e-41a0-9123-907cd3a930fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.470295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435953d2-a15e-41a0-9123-907cd3a930fb None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.470748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435953d2-a15e-41a0-9123-907cd3a930fb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.471194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435953d2-a15e-41a0-9123-907cd3a930fb None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.472056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435953d2-a15e-41a0-9123-907cd3a930fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.473761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435953d2-a15e-41a0-9123-907cd3a930fb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.507659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22da29-d1db-41c5-92af-5275e829d4f6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.541042 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c9065-7501-4b2c-98a9-cba9a74e0d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.541700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c9065-7501-4b2c-98a9-cba9a74e0d6e None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.541979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c9065-7501-4b2c-98a9-cba9a74e0d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.542251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c9065-7501-4b2c-98a9-cba9a74e0d6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.542981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c9065-7501-4b2c-98a9-cba9a74e0d6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.544357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c9065-7501-4b2c-98a9-cba9a74e0d6e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.575000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 514/1019] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:31 2022] POST /identity/v3/services => generated 242 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:31.657239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 506/1020] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:33.427213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a2ac0-ed81-4f42-bb3c-1b51ff5a28ef None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.427757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a2ac0-ed81-4f42-bb3c-1b51ff5a28ef None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.427757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a2ac0-ed81-4f42-bb3c-1b51ff5a28ef None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.429216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 515/1021] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:33.434460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279665a4-7af8-4119-b15b-4a407373d955 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.434847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279665a4-7af8-4119-b15b-4a407373d955 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.435043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279665a4-7af8-4119-b15b-4a407373d955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.452006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-279665a4-7af8-4119-b15b-4a407373d955 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:33.453192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-279665a4-7af8-4119-b15b-4a407373d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:33.464707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:33.532906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 507/1022] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:33.557927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a2ac0-ed81-4f42-bb3c-1b51ff5a28ef None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:33.567449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:33.663216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a2ac0-ed81-4f42-bb3c-1b51ff5a28ef None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:33.700639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58853457-058a-486b-97b2-b64999251499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:33.701437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58853457-058a-486b-97b2-b64999251499 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.701721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58853457-058a-486b-97b2-b64999251499 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.701998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58853457-058a-486b-97b2-b64999251499 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.703204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58853457-058a-486b-97b2-b64999251499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:33.704647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58853457-058a-486b-97b2-b64999251499 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:33.711151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 516/1023] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:33.713060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279665a4-7af8-4119-b15b-4a407373d955 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:33.814577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279665a4-7af8-4119-b15b-4a407373d955 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:33.843455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2d08-53e1-4981-8f4b-ac4734c1df73 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.843806 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2d08-53e1-4981-8f4b-ac4734c1df73 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.844102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2d08-53e1-4981-8f4b-ac4734c1df73 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.845464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 517/1024] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:33.850796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985c52-151e-4381-8a48-5d42b276784e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.851085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985c52-151e-4381-8a48-5d42b276784e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.851287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e344b-ec2c-4228-adf2-4a72c26d8495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:33.851401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985c52-151e-4381-8a48-5d42b276784e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.851942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e344b-ec2c-4228-adf2-4a72c26d8495 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.852226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e344b-ec2c-4228-adf2-4a72c26d8495 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.852500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e344b-ec2c-4228-adf2-4a72c26d8495 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.853216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e344b-ec2c-4228-adf2-4a72c26d8495 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:33.854652 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e344b-ec2c-4228-adf2-4a72c26d8495 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:33.870162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-be985c52-151e-4381-8a48-5d42b276784e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:33.871593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-be985c52-151e-4381-8a48-5d42b276784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:33.936158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:33.940943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 518/1025] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:33.965415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be985c52-151e-4381-8a48-5d42b276784e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:33.968976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:33.973433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 508/1026] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:55:33 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:34.001475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6531d0-c609-4b28-bbd4-b80af10ac6e9 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.001767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6531d0-c609-4b28-bbd4-b80af10ac6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.002047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6531d0-c609-4b28-bbd4-b80af10ac6e9 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.003525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 509/1027] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:34.010473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0e1a-e51c-44ee-b56f-653c2242857c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.011067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0e1a-e51c-44ee-b56f-653c2242857c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.011373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0e1a-e51c-44ee-b56f-653c2242857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.029814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-562f0e1a-e51c-44ee-b56f-653c2242857c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:34.031036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-562f0e1a-e51c-44ee-b56f-653c2242857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:34.094859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be985c52-151e-4381-8a48-5d42b276784e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.113749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 510/1028] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:34.135444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e02440-6dc2-4ca9-8bac-28b3da574b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.139413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e02440-6dc2-4ca9-8bac-28b3da574b96 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.139413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e02440-6dc2-4ca9-8bac-28b3da574b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.139413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e02440-6dc2-4ca9-8bac-28b3da574b96 None admin] PATH_INFO: `/v3/services/image` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.139413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e02440-6dc2-4ca9-8bac-28b3da574b96 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:34.139784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f0e1a-e51c-44ee-b56f-653c2242857c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:34.139884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e02440-6dc2-4ca9-8bac-28b3da574b96 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-97e02440-6dc2-4ca9-8bac-28b3da574b96 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:34.152578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:34.153696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:34.154550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:34.159362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 519/1029] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Jun 2 09:55:33 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:34.160294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e02440-6dc2-4ca9-8bac-28b3da574b96 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:34.243269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:34.258731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f0e1a-e51c-44ee-b56f-653c2242857c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.283402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e02440-6dc2-4ca9-8bac-28b3da574b96 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.288847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:34.297866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88edf92-a448-4721-aa59-4ede0e787b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.298687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88edf92-a448-4721-aa59-4ede0e787b6a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.298966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88edf92-a448-4721-aa59-4ede0e787b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.300172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88edf92-a448-4721-aa59-4ede0e787b6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.310087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88edf92-a448-4721-aa59-4ede0e787b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-e88edf92-a448-4721-aa59-4ede0e787b6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:34.318965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:34.320803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:34.321852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:34.324763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa97b29-c297-4c03-a724-5fb5432d858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.325659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97b29-c297-4c03-a724-5fb5432d858a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.326008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 511/1030] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:34.326254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97b29-c297-4c03-a724-5fb5432d858a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.326670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97b29-c297-4c03-a724-5fb5432d858a None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.326838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88edf92-a448-4721-aa59-4ede0e787b6a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:34.327713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa97b29-c297-4c03-a724-5fb5432d858a None admin] RBAC: Adding query filter params (name=image) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:34.328164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa97b29-c297-4c03-a724-5fb5432d858a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:34.329880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa97b29-c297-4c03-a724-5fb5432d858a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:34.336903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 520/1031] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:34.343131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa97b29-c297-4c03-a724-5fb5432d858a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:34.434793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88edf92-a448-4721-aa59-4ede0e787b6a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.454387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa97b29-c297-4c03-a724-5fb5432d858a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.470054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31a802-472e-43c9-b37f-43dc78637da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.470786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31a802-472e-43c9-b37f-43dc78637da6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.471071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31a802-472e-43c9-b37f-43dc78637da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.471422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31a802-472e-43c9-b37f-43dc78637da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.472166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31a802-472e-43c9-b37f-43dc78637da6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:34.472472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31a802-472e-43c9-b37f-43dc78637da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:34.473820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31a802-472e-43c9-b37f-43dc78637da6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:34.482267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 512/1032] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:34.485524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:34.487949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31a802-472e-43c9-b37f-43dc78637da6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:34.492042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42d7ef-4a54-4c5a-be7f-ed6efae06d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.492714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d7ef-4a54-4c5a-be7f-ed6efae06d58 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.492993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d7ef-4a54-4c5a-be7f-ed6efae06d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.493263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d7ef-4a54-4c5a-be7f-ed6efae06d58 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.493965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42d7ef-4a54-4c5a-be7f-ed6efae06d58 None admin] RBAC: Adding query filter params (type=image) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:34.494270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42d7ef-4a54-4c5a-be7f-ed6efae06d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:34.495735 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42d7ef-4a54-4c5a-be7f-ed6efae06d58 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:34.505978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 521/1033] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:34.506820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42d7ef-4a54-4c5a-be7f-ed6efae06d58 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:34.546913 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:34.601061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31a802-472e-43c9-b37f-43dc78637da6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.620229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42d7ef-4a54-4c5a-be7f-ed6efae06d58 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.637858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89f052-1b4c-4b28-a862-4cb60a5832c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.638650 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89f052-1b4c-4b28-a862-4cb60a5832c1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.638928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89f052-1b4c-4b28-a862-4cb60a5832c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.639227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89f052-1b4c-4b28-a862-4cb60a5832c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.650592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89f052-1b4c-4b28-a862-4cb60a5832c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:34.652181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89f052-1b4c-4b28-a862-4cb60a5832c1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:34.654819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc1e9-fefa-46d6-a7d1-b6040b6d351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.655511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc1e9-fefa-46d6-a7d1-b6040b6d351c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.655797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc1e9-fefa-46d6-a7d1-b6040b6d351c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.656073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc1e9-fefa-46d6-a7d1-b6040b6d351c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.656855 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc1e9-fefa-46d6-a7d1-b6040b6d351c None admin] RBAC: Adding query filter params (interface=public, service_id=c58e84ac388c42619de0bf6ca4fbc773, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:34.657168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc1e9-fefa-46d6-a7d1-b6040b6d351c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:34.658622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc1e9-fefa-46d6-a7d1-b6040b6d351c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:34.668646 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 522/1034] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:34 2022] GET /identity/v3/endpoints?service_id=c58e84ac388c42619de0bf6ca4fbc773&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:34.669598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc1e9-fefa-46d6-a7d1-b6040b6d351c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0f89f052-1b4c-4b28-a862-4cb60a5832c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:34.669826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:34.670671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:34.672317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:34.672317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:34.672317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:34.672317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:34.672317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 513/1035] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:34.676290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89f052-1b4c-4b28-a862-4cb60a5832c1 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:34.737607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:34.782417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc1e9-fefa-46d6-a7d1-b6040b6d351c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.783055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89f052-1b4c-4b28-a862-4cb60a5832c1 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.785538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:34.818193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b52fb-e9bc-4251-9568-e82a6797d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.818865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b52fb-e9bc-4251-9568-e82a6797d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.819207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b52fb-e9bc-4251-9568-e82a6797d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.819312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21bcf-fb7f-47c0-9ebc-e3f89f5dea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.819523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b52fb-e9bc-4251-9568-e82a6797d6e6 None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.819916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21bcf-fb7f-47c0-9ebc-e3f89f5dea9e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.820161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b52fb-e9bc-4251-9568-e82a6797d6e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:34.820259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21bcf-fb7f-47c0-9ebc-e3f89f5dea9e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.820448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21bcf-fb7f-47c0-9ebc-e3f89f5dea9e None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.821154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21bcf-fb7f-47c0-9ebc-e3f89f5dea9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:34.821456 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21bcf-fb7f-47c0-9ebc-e3f89f5dea9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:34.821549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b52fb-e9bc-4251-9568-e82a6797d6e6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:34.822784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21bcf-fb7f-47c0-9ebc-e3f89f5dea9e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:34.840377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 523/1036] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:34 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:34.845871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 514/1037] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:34.852245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b52fb-e9bc-4251-9568-e82a6797d6e6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:34.961536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b52fb-e9bc-4251-9568-e82a6797d6e6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:34.987020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:34.998739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b788f5-a80c-4074-93e4-a295854c2007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.999519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b788f5-a80c-4074-93e4-a295854c2007 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.999801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b788f5-a80c-4074-93e4-a295854c2007 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:35.000074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b788f5-a80c-4074-93e4-a295854c2007 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:35.008548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b788f5-a80c-4074-93e4-a295854c2007 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:35.010003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b788f5-a80c-4074-93e4-a295854c2007 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-41b788f5-a80c-4074-93e4-a295854c2007 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:35.025174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:35.026204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:35.027517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 524/1038] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 2 09:55:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:35.032156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21bcf-fb7f-47c0-9ebc-e3f89f5dea9e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:35.132908 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21bcf-fb7f-47c0-9ebc-e3f89f5dea9e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:35.165808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28521dbb-ba52-4752-93fe-8893961ab0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:35.166484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521dbb-ba52-4752-93fe-8893961ab0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:35.166766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521dbb-ba52-4752-93fe-8893961ab0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:35.167035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521dbb-ba52-4752-93fe-8893961ab0b9 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:35.167917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28521dbb-ba52-4752-93fe-8893961ab0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:35.168223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28521dbb-ba52-4752-93fe-8893961ab0b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:35.169680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28521dbb-ba52-4752-93fe-8893961ab0b9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:35.188990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 515/1039] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 2 09:55:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:35.194925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b788f5-a80c-4074-93e4-a295854c2007 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:35.304401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b788f5-a80c-4074-93e4-a295854c2007 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:35.340210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36c743-b829-44a1-bab7-ca66b86a9a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:35.340864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36c743-b829-44a1-bab7-ca66b86a9a28 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:35.341145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36c743-b829-44a1-bab7-ca66b86a9a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:35.341418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36c743-b829-44a1-bab7-ca66b86a9a28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:35.394257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:35.410910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36c743-b829-44a1-bab7-ca66b86a9a28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:35.412380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36c743-b829-44a1-bab7-ca66b86a9a28 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:35.512259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 525/1040] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:35.518099 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28521dbb-ba52-4752-93fe-8893961ab0b9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:35.540427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:35.618717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28521dbb-ba52-4752-93fe-8893961ab0b9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:35.653085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527c4c2-154c-4a2a-8296-1b1d853aa28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:35.653878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527c4c2-154c-4a2a-8296-1b1d853aa28e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:35.654156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527c4c2-154c-4a2a-8296-1b1d853aa28e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:35.654425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527c4c2-154c-4a2a-8296-1b1d853aa28e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:35.664579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527c4c2-154c-4a2a-8296-1b1d853aa28e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:35.666013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527c4c2-154c-4a2a-8296-1b1d853aa28e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-a527c4c2-154c-4a2a-8296-1b1d853aa28e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:35.683869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:35.684878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:35.685774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:35.685774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:35.685774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:35.685774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:35.685774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 516/1041] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:35.690592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36c743-b829-44a1-bab7-ca66b86a9a28 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:35.775061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:35.791030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36c743-b829-44a1-bab7-ca66b86a9a28 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:35.826145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0336ab-85be-4375-81a9-1596009af138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:35.826809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0336ab-85be-4375-81a9-1596009af138 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:35.827088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0336ab-85be-4375-81a9-1596009af138 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:35.827384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0336ab-85be-4375-81a9-1596009af138 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:35.828101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0336ab-85be-4375-81a9-1596009af138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:35.828674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0336ab-85be-4375-81a9-1596009af138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:35.830039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0336ab-85be-4375-81a9-1596009af138 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:35.841974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 526/1042] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:35.847297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527c4c2-154c-4a2a-8296-1b1d853aa28e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:35.946504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:35.979075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527c4c2-154c-4a2a-8296-1b1d853aa28e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:36.016861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90b36-d111-4e76-a2e8-34bb1e82a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:36.017672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90b36-d111-4e76-a2e8-34bb1e82a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.017951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90b36-d111-4e76-a2e8-34bb1e82a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.018221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90b36-d111-4e76-a2e8-34bb1e82a5c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.025618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90b36-d111-4e76-a2e8-34bb1e82a5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:36.027069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90b36-d111-4e76-a2e8-34bb1e82a5c3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-4ad90b36-d111-4e76-a2e8-34bb1e82a5c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:36.041208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:36.042075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:36.042960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:36.042960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:36.042960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:36.042960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:36.042960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:36.042960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:36.042960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:36.042960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:36.042960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 517/1043] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:36.048130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0336ab-85be-4375-81a9-1596009af138 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:36.147852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0336ab-85be-4375-81a9-1596009af138 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:36.181687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6e3a-404e-4071-bf36-92361e13bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:36.182344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6e3a-404e-4071-bf36-92361e13bd16 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.182626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6e3a-404e-4071-bf36-92361e13bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.182899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6e3a-404e-4071-bf36-92361e13bd16 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.183707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6e3a-404e-4071-bf36-92361e13bd16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:36.184015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6e3a-404e-4071-bf36-92361e13bd16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:36.185436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6e3a-404e-4071-bf36-92361e13bd16 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:36.198286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 527/1044] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:36.204023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90b36-d111-4e76-a2e8-34bb1e82a5c3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:36.312835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90b36-d111-4e76-a2e8-34bb1e82a5c3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:36.325455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831c100-98d1-453f-9d1d-d2c25c420e30 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.325731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831c100-98d1-453f-9d1d-d2c25c420e30 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.326010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831c100-98d1-453f-9d1d-d2c25c420e30 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.327530 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 528/1045] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:36.332259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a6beb-b44f-4112-ad3a-9344ac2a63ec None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.332542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a6beb-b44f-4112-ad3a-9344ac2a63ec None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.332814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a6beb-b44f-4112-ad3a-9344ac2a63ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.339434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:36.345330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:36.349960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e07a6beb-b44f-4112-ad3a-9344ac2a63ec None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:36.350801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3305fe3-34dd-4723-89d5-1aa053c0db78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:36.351493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3305fe3-34dd-4723-89d5-1aa053c0db78 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.355970 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e07a6beb-b44f-4112-ad3a-9344ac2a63ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:36.356083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3305fe3-34dd-4723-89d5-1aa053c0db78 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.356083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3305fe3-34dd-4723-89d5-1aa053c0db78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.356083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3305fe3-34dd-4723-89d5-1aa053c0db78 None admin] RBAC: Adding query filter params (role.id=407071ed54014753a3e4d05e5b145946, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=0b0591179ec144f5a90c9a24205b6b47) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:36.356083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3305fe3-34dd-4723-89d5-1aa053c0db78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:36.356083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3305fe3-34dd-4723-89d5-1aa053c0db78 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:36.366179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 518/1046] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:36 2022] GET /identity/v3/role_assignments?user.id=0b0591179ec144f5a90c9a24205b6b47&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=407071ed54014753a3e4d05e5b145946 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:36.427273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 529/1047] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:36.449754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3305fe3-34dd-4723-89d5-1aa053c0db78 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:36.561308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3305fe3-34dd-4723-89d5-1aa053c0db78 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:36.597352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ed1d-e877-4147-aedd-dc0029a5fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:36.598051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ed1d-e877-4147-aedd-dc0029a5fce7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.598333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ed1d-e877-4147-aedd-dc0029a5fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.598604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ed1d-e877-4147-aedd-dc0029a5fce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.609242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ed1d-e877-4147-aedd-dc0029a5fce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-43a3ed1d-e877-4147-aedd-dc0029a5fce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:36.616790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:36.617708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:36.618561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 519/1048] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:36.625577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a6beb-b44f-4112-ad3a-9344ac2a63ec None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:36.727169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a6beb-b44f-4112-ad3a-9344ac2a63ec None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:36.761318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531396a7-ee0d-4582-92fb-024069c904d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:36.761985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531396a7-ee0d-4582-92fb-024069c904d5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.762262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531396a7-ee0d-4582-92fb-024069c904d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.762532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531396a7-ee0d-4582-92fb-024069c904d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.763465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531396a7-ee0d-4582-92fb-024069c904d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:36.763769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531396a7-ee0d-4582-92fb-024069c904d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:36.765315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531396a7-ee0d-4582-92fb-024069c904d5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:36.766688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:36.780804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 530/1049] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:36.782202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ed1d-e877-4147-aedd-dc0029a5fce7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:36.844745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:36.887800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ed1d-e877-4147-aedd-dc0029a5fce7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:36.922441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093cf37-b1fb-4d0b-ba77-50916a713873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:36.923337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093cf37-b1fb-4d0b-ba77-50916a713873 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.923616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093cf37-b1fb-4d0b-ba77-50916a713873 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.923883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093cf37-b1fb-4d0b-ba77-50916a713873 None admin] PATH_INFO: `/v3/users/bdbc249633874f3a87b325cabb1c2af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.937454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093cf37-b1fb-4d0b-ba77-50916a713873 None admin] RBAC: Authorizing `identity:get_user(user_id=bdbc249633874f3a87b325cabb1c2af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:36.938937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093cf37-b1fb-4d0b-ba77-50916a713873 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:36.950230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 520/1050] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:36 2022] GET /identity/v3/users/bdbc249633874f3a87b325cabb1c2af3 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:36.951431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531396a7-ee0d-4582-92fb-024069c904d5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:37.051022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531396a7-ee0d-4582-92fb-024069c904d5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:37.085297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61d52f-e664-4091-a80a-fe11b46747ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:37.085948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61d52f-e664-4091-a80a-fe11b46747ab None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:37.086224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61d52f-e664-4091-a80a-fe11b46747ab None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:37.086491 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61d52f-e664-4091-a80a-fe11b46747ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:37.118300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5533ab-07ed-406c-96b2-f79a6ea9f47f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:37.118586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5533ab-07ed-406c-96b2-f79a6ea9f47f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:37.118860 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5533ab-07ed-406c-96b2-f79a6ea9f47f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:37.120283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 521/1051] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:37.125297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c32820-c4af-48c2-9954-1fb41c9d2b3b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:37.125580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c32820-c4af-48c2-9954-1fb41c9d2b3b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:37.125853 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c32820-c4af-48c2-9954-1fb41c9d2b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:37.143020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-46c32820-c4af-48c2-9954-1fb41c9d2b3b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:37.144160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-46c32820-c4af-48c2-9954-1fb41c9d2b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:37.152588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:37.159517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61d52f-e664-4091-a80a-fe11b46747ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:37.160948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61d52f-e664-4091-a80a-fe11b46747ab None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:37.220382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 522/1052] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:37.243356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c32820-c4af-48c2-9954-1fb41c9d2b3b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:37.271410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 531/1053] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:37.273812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61d52f-e664-4091-a80a-fe11b46747ab None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:37.297998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:37.355212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c32820-c4af-48c2-9954-1fb41c9d2b3b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:37.371332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:37.377279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61d52f-e664-4091-a80a-fe11b46747ab None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:37.391213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab9e6-fca1-4ae4-bf22-a5d2b89fb2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:37.391929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab9e6-fca1-4ae4-bf22-a5d2b89fb2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:37.392231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab9e6-fca1-4ae4-bf22-a5d2b89fb2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:37.392476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab9e6-fca1-4ae4-bf22-a5d2b89fb2c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:37.393176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fab9e6-fca1-4ae4-bf22-a5d2b89fb2c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:37.394467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fab9e6-fca1-4ae4-bf22-a5d2b89fb2c3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-38fab9e6-fca1-4ae4-bf22-a5d2b89fb2c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:37.406154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:37.407199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:37.408222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 523/1054] 10.222.0.13 () {56 vars in 1105 bytes} [Thu Jun 2 09:55:37 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:37.413682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab9e6-fca1-4ae4-bf22-a5d2b89fb2c3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:37.415926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c8a6f-ffb1-4e50-ac0b-46aee59b83a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:37.416858 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8a6f-ffb1-4e50-ac0b-46aee59b83a8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:37.417137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8a6f-ffb1-4e50-ac0b-46aee59b83a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:37.417407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8a6f-ffb1-4e50-ac0b-46aee59b83a8 None admin] PATH_INFO: `/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:37.418584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c8a6f-ffb1-4e50-ac0b-46aee59b83a8 None admin] RBAC: Authorizing `identity:get_project(project_id=3da60ffeabde4bbeba4b20cb60f8f376)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:37.420033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c8a6f-ffb1-4e50-ac0b-46aee59b83a8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:37.421866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 532/1055] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:37 2022] GET /identity/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:37.427962 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c8a6f-ffb1-4e50-ac0b-46aee59b83a8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:37.524973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab9e6-fca1-4ae4-bf22-a5d2b89fb2c3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:37.534735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:37.539149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c8a6f-ffb1-4e50-ac0b-46aee59b83a8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:37.560397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb5273-1eca-475c-9061-20aca38703fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:37.561067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb5273-1eca-475c-9061-20aca38703fc None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:37.561407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb5273-1eca-475c-9061-20aca38703fc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:37.561941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb5273-1eca-475c-9061-20aca38703fc None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:37.562411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb5273-1eca-475c-9061-20aca38703fc None admin] RBAC: Adding query filter params (name=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:37.562977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb5273-1eca-475c-9061-20aca38703fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:37.564979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb5273-1eca-475c-9061-20aca38703fc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:37.570436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 524/1056] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:37.576012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb5273-1eca-475c-9061-20aca38703fc None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:37.577462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac805c-61fa-49db-8535-0420e5991c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:37.578121 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac805c-61fa-49db-8535-0420e5991c94 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:37.578402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac805c-61fa-49db-8535-0420e5991c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:37.578681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac805c-61fa-49db-8535-0420e5991c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:37.579540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac805c-61fa-49db-8535-0420e5991c94 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=3da60ffeabde4bbeba4b20cb60f8f376, user.id=bdbc249633874f3a87b325cabb1c2af3) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:37.579859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac805c-61fa-49db-8535-0420e5991c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:37.581281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac805c-61fa-49db-8535-0420e5991c94 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:37.587041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 533/1057] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:37 2022] GET /identity/v3/role_assignments?user.id=bdbc249633874f3a87b325cabb1c2af3&scope.project.id=3da60ffeabde4bbeba4b20cb60f8f376&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:37.687131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb5273-1eca-475c-9061-20aca38703fc None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:37.721988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4de67-195c-4093-9889-c2f8b086bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:37.722668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4de67-195c-4093-9889-c2f8b086bf2a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:37.722945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4de67-195c-4093-9889-c2f8b086bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:37.723245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4de67-195c-4093-9889-c2f8b086bf2a None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:37.723957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4de67-195c-4093-9889-c2f8b086bf2a None admin] RBAC: Adding query filter params (type=image) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:37.724259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4de67-195c-4093-9889-c2f8b086bf2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:37.726180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4de67-195c-4093-9889-c2f8b086bf2a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:37.731990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 525/1058] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:37.737467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac805c-61fa-49db-8535-0420e5991c94 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:37.767959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:37.847540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac805c-61fa-49db-8535-0420e5991c94 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:37.883231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b67f4-00ef-42f6-a4ac-995852e8ac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:37.883897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b67f4-00ef-42f6-a4ac-995852e8ac4a None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:37.884178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b67f4-00ef-42f6-a4ac-995852e8ac4a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:37.884450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b67f4-00ef-42f6-a4ac-995852e8ac4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:37.885201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b67f4-00ef-42f6-a4ac-995852e8ac4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:37.886557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b67f4-00ef-42f6-a4ac-995852e8ac4a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:37.993424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 534/1059] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:38.617038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990cff8-8f79-48fe-a95e-77e66c91b5d5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:38.617558 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990cff8-8f79-48fe-a95e-77e66c91b5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:38.617558 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990cff8-8f79-48fe-a95e-77e66c91b5d5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:38.620008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 526/1060] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:38.624512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b73120-f6f6-480f-bb41-8bad2005c296 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:38.624805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b73120-f6f6-480f-bb41-8bad2005c296 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:38.625080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b73120-f6f6-480f-bb41-8bad2005c296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:38.642443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-16b73120-f6f6-480f-bb41-8bad2005c296 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:38.643658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-16b73120-f6f6-480f-bb41-8bad2005c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:38.720012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 535/1061] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:38.743453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990cff8-8f79-48fe-a95e-77e66c91b5d5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:38.780794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:38.847356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990cff8-8f79-48fe-a95e-77e66c91b5d5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:38.881922 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597fc44-ad2c-476c-865c-7fa2bd5eef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:38.882660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597fc44-ad2c-476c-865c-7fa2bd5eef78 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:38.882939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597fc44-ad2c-476c-865c-7fa2bd5eef78 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:38.883245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597fc44-ad2c-476c-865c-7fa2bd5eef78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:38.893337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597fc44-ad2c-476c-865c-7fa2bd5eef78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f597fc44-ad2c-476c-865c-7fa2bd5eef78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:38.901484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:38.902391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:38.903310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:38.907168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 527/1062] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:38.908953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b73120-f6f6-480f-bb41-8bad2005c296 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:38.921457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:39.008553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b73120-f6f6-480f-bb41-8bad2005c296 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.042132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2919f-07e9-4178-8b66-61f9d7e5e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.042797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2919f-07e9-4178-8b66-61f9d7e5e223 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.043079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2919f-07e9-4178-8b66-61f9d7e5e223 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.043383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2919f-07e9-4178-8b66-61f9d7e5e223 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.044122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2919f-07e9-4178-8b66-61f9d7e5e223 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:39.044429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2919f-07e9-4178-8b66-61f9d7e5e223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.045810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2919f-07e9-4178-8b66-61f9d7e5e223 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.054449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 536/1063] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:39.060236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597fc44-ad2c-476c-865c-7fa2bd5eef78 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.156263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:39.163265 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597fc44-ad2c-476c-865c-7fa2bd5eef78 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.197443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913a3a7-2b0b-43f8-bfaf-4f925d3c1c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.198726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913a3a7-2b0b-43f8-bfaf-4f925d3c1c05 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.199262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913a3a7-2b0b-43f8-bfaf-4f925d3c1c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.199752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913a3a7-2b0b-43f8-bfaf-4f925d3c1c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.211156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913a3a7-2b0b-43f8-bfaf-4f925d3c1c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.212834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913a3a7-2b0b-43f8-bfaf-4f925d3c1c05 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0913a3a7-2b0b-43f8-bfaf-4f925d3c1c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:39.231234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:39.232137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:39.233041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:39.233041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:39.233041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:39.233041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:39.235239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 528/1064] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:39.239351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2919f-07e9-4178-8b66-61f9d7e5e223 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.313956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:39.343391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2919f-07e9-4178-8b66-61f9d7e5e223 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.378275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d29285-0dea-474a-9cbe-2251ad55b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.378936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d29285-0dea-474a-9cbe-2251ad55b502 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.379242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d29285-0dea-474a-9cbe-2251ad55b502 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.379518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d29285-0dea-474a-9cbe-2251ad55b502 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.380229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d29285-0dea-474a-9cbe-2251ad55b502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:39.380530 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d29285-0dea-474a-9cbe-2251ad55b502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.381898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d29285-0dea-474a-9cbe-2251ad55b502 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.398484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 537/1065] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:39.400048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913a3a7-2b0b-43f8-bfaf-4f925d3c1c05 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.503996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913a3a7-2b0b-43f8-bfaf-4f925d3c1c05 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.540638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d619238-ebac-4d1b-a95a-603c26c5095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.541437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d619238-ebac-4d1b-a95a-603c26c5095b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.541720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d619238-ebac-4d1b-a95a-603c26c5095b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.541994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d619238-ebac-4d1b-a95a-603c26c5095b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.549594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d619238-ebac-4d1b-a95a-603c26c5095b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.551013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d619238-ebac-4d1b-a95a-603c26c5095b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8d619238-ebac-4d1b-a95a-603c26c5095b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:39.564752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:39.565712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:39.566665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:39.570712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 529/1066] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:39.572085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d29285-0dea-474a-9cbe-2251ad55b502 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.675969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d29285-0dea-474a-9cbe-2251ad55b502 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.706395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:39.712637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3159-4fed-40dd-ba15-4533199589ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.713317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3159-4fed-40dd-ba15-4533199589ea None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.713596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3159-4fed-40dd-ba15-4533199589ea None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.713866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3159-4fed-40dd-ba15-4533199589ea None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.715027 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf3159-4fed-40dd-ba15-4533199589ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:39.715459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf3159-4fed-40dd-ba15-4533199589ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.716836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf3159-4fed-40dd-ba15-4533199589ea None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.738437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 538/1067] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:39.740058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d619238-ebac-4d1b-a95a-603c26c5095b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.752083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:39.833735 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26868a-b484-4e82-9d50-439c48a6d721 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.834047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26868a-b484-4e82-9d50-439c48a6d721 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.834858 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26868a-b484-4e82-9d50-439c48a6d721 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.836393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 539/1068] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:39.841562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a663-3eef-4187-8cc8-cb14316577f2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.845542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a663-3eef-4187-8cc8-cb14316577f2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.845542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a663-3eef-4187-8cc8-cb14316577f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.845710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d619238-ebac-4d1b-a95a-603c26c5095b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.864343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bb92a663-3eef-4187-8cc8-cb14316577f2 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:39.865534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bb92a663-3eef-4187-8cc8-cb14316577f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:39.882239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c4cf7-f964-4776-b359-0deed9e82055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.883277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c4cf7-f964-4776-b359-0deed9e82055 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.883717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c4cf7-f964-4776-b359-0deed9e82055 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.883992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c4cf7-f964-4776-b359-0deed9e82055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.895085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c4cf7-f964-4776-b359-0deed9e82055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.896622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c4cf7-f964-4776-b359-0deed9e82055 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-f70c4cf7-f964-4776-b359-0deed9e82055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:39.915107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:39.916195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:39.917139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:39.917139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:39.917139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:39.917139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:39.917139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 530/1069] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:39.922428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c4cf7-f964-4776-b359-0deed9e82055 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.951381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 540/1070] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:39.973918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a663-3eef-4187-8cc8-cb14316577f2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.988032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:40.032403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c4cf7-f964-4776-b359-0deed9e82055 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.069678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f8599-f8fb-4937-b7bb-631b452c19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.070339 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8599-f8fb-4937-b7bb-631b452c19ed None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.070617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8599-f8fb-4937-b7bb-631b452c19ed None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.070885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8599-f8fb-4937-b7bb-631b452c19ed None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.071637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f8599-f8fb-4937-b7bb-631b452c19ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:40.071937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f8599-f8fb-4937-b7bb-631b452c19ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:40.073286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f8599-f8fb-4937-b7bb-631b452c19ed None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:40.076984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a663-3eef-4187-8cc8-cb14316577f2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.085729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 531/1071] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:40.091172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f8599-f8fb-4937-b7bb-631b452c19ed None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:40.100725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:40.116698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5747741-5c6b-4928-91b1-5dad3a3dd355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.117604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5747741-5c6b-4928-91b1-5dad3a3dd355 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.117998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5747741-5c6b-4928-91b1-5dad3a3dd355 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.118279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5747741-5c6b-4928-91b1-5dad3a3dd355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.129058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5747741-5c6b-4928-91b1-5dad3a3dd355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f5747741-5c6b-4928-91b1-5dad3a3dd355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:40.138829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:40.139796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:40.140793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 541/1072] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:40.145989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5747741-5c6b-4928-91b1-5dad3a3dd355 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:40.201767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f8599-f8fb-4937-b7bb-631b452c19ed None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.222397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:40.236796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529794e8-7777-45e7-b318-ce600ecd5ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.237594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529794e8-7777-45e7-b318-ce600ecd5ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.237877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529794e8-7777-45e7-b318-ce600ecd5ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.238159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529794e8-7777-45e7-b318-ce600ecd5ef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.246479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529794e8-7777-45e7-b318-ce600ecd5ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:40.247948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529794e8-7777-45e7-b318-ce600ecd5ef3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:40.251577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5747741-5c6b-4928-91b1-5dad3a3dd355 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-529794e8-7777-45e7-b318-ce600ecd5ef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:40.266273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:40.267318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:40.268317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:40.268317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:40.268317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:40.268317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:40.268317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:40.268317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:40.268317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:40.268317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:40.268317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 532/1073] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:40.269517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10223c74-9ce9-4d65-87e6-3c30f2e5af37 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.269806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10223c74-9ce9-4d65-87e6-3c30f2e5af37 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.270081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10223c74-9ce9-4d65-87e6-3c30f2e5af37 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.271376 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 533/1074] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:40.273428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10223c74-9ce9-4d65-87e6-3c30f2e5af37 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:40.290241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bced9-406f-4164-a394-b4ab172be595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.290902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bced9-406f-4164-a394-b4ab172be595 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.291219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bced9-406f-4164-a394-b4ab172be595 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.291490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bced9-406f-4164-a394-b4ab172be595 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.292225 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bced9-406f-4164-a394-b4ab172be595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:40.292527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bced9-406f-4164-a394-b4ab172be595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:40.293872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bced9-406f-4164-a394-b4ab172be595 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:40.307017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 542/1075] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:40.307017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b48a8-0389-4002-94fc-c52c01fa66a5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.307017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b48a8-0389-4002-94fc-c52c01fa66a5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.307017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b48a8-0389-4002-94fc-c52c01fa66a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.320972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5b0b48a8-0389-4002-94fc-c52c01fa66a5 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:40.322159 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5b0b48a8-0389-4002-94fc-c52c01fa66a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:40.356151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:40.374442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10223c74-9ce9-4d65-87e6-3c30f2e5af37 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.387084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 543/1076] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:40.387930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b48a8-0389-4002-94fc-c52c01fa66a5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:40.410378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f2ecb-6419-4d64-97d5-52fbe3e2617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.411038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f2ecb-6419-4d64-97d5-52fbe3e2617d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.411355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f2ecb-6419-4d64-97d5-52fbe3e2617d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.411632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f2ecb-6419-4d64-97d5-52fbe3e2617d None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.412940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f2ecb-6419-4d64-97d5-52fbe3e2617d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:40.413253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f2ecb-6419-4d64-97d5-52fbe3e2617d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:40.414697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f2ecb-6419-4d64-97d5-52fbe3e2617d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:40.431587 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 534/1077] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:40.431587 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f2ecb-6419-4d64-97d5-52fbe3e2617d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:40.469945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:40.491984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b48a8-0389-4002-94fc-c52c01fa66a5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.524933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efeca4-835f-4c6f-9102-5ee672374312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.525799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efeca4-835f-4c6f-9102-5ee672374312 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.526079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efeca4-835f-4c6f-9102-5ee672374312 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.526351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efeca4-835f-4c6f-9102-5ee672374312 None admin] PATH_INFO: `/v3/users/bdbc249633874f3a87b325cabb1c2af3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.527126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f2ecb-6419-4d64-97d5-52fbe3e2617d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.527569 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efeca4-835f-4c6f-9102-5ee672374312 None admin] RBAC: Authorizing `identity:get_user(user_id=bdbc249633874f3a87b325cabb1c2af3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:40.529007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efeca4-835f-4c6f-9102-5ee672374312 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:40.530631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 544/1078] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:40 2022] GET /identity/v3/users/bdbc249633874f3a87b325cabb1c2af3 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:40.531389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efeca4-835f-4c6f-9102-5ee672374312 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:40.561686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef3561-d5f8-4bb5-b550-635b0693d95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.562333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef3561-d5f8-4bb5-b550-635b0693d95c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.562620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef3561-d5f8-4bb5-b550-635b0693d95c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.562896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef3561-d5f8-4bb5-b550-635b0693d95c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.575873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:40.630270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef3561-d5f8-4bb5-b550-635b0693d95c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:40.631702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef3561-d5f8-4bb5-b550-635b0693d95c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:40.632467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efeca4-835f-4c6f-9102-5ee672374312 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.665968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1b39-5a47-4c0e-9169-7fba0eb40d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.666837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1b39-5a47-4c0e-9169-7fba0eb40d36 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.667145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1b39-5a47-4c0e-9169-7fba0eb40d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.667417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1b39-5a47-4c0e-9169-7fba0eb40d36 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/0b0591179ec144f5a90c9a24205b6b47/roles/407071ed54014753a3e4d05e5b145946` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.669635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d1b39-5a47-4c0e-9169-7fba0eb40d36 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=0b0591179ec144f5a90c9a24205b6b47, role_id=407071ed54014753a3e4d05e5b145946)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:40.670301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:40.671058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d1b39-5a47-4c0e-9169-7fba0eb40d36 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:40.728065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 535/1079] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:40.728877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef3561-d5f8-4bb5-b550-635b0693d95c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:40.757145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 545/1080] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:40 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/0b0591179ec144f5a90c9a24205b6b47/roles/407071ed54014753a3e4d05e5b145946 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:55:40.758153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1b39-5a47-4c0e-9169-7fba0eb40d36 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:40.862108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef3561-d5f8-4bb5-b550-635b0693d95c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.871863 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:40.875919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1b39-5a47-4c0e-9169-7fba0eb40d36 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:40.900676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ddfa1-f8ff-46d7-8942-020847ec064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.901532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ddfa1-f8ff-46d7-8942-020847ec064d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.901817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ddfa1-f8ff-46d7-8942-020847ec064d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.902131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ddfa1-f8ff-46d7-8942-020847ec064d None admin] PATH_INFO: `/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.903399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ddfa1-f8ff-46d7-8942-020847ec064d None admin] RBAC: Authorizing `identity:get_project(project_id=3da60ffeabde4bbeba4b20cb60f8f376)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:40.904879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ddfa1-f8ff-46d7-8942-020847ec064d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:40.906979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 536/1081] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:40 2022] GET /identity/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:40.913399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ddfa1-f8ff-46d7-8942-020847ec064d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:40.919867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ae1d-7d46-496b-b845-3bb26af3fd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:40.920675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ae1d-7d46-496b-b845-3bb26af3fd9b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:40.920952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ae1d-7d46-496b-b845-3bb26af3fd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:40.921227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ae1d-7d46-496b-b845-3bb26af3fd9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:40.924945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:40.933434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54ae1d-7d46-496b-b845-3bb26af3fd9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:40.934918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54ae1d-7d46-496b-b845-3bb26af3fd9b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9e54ae1d-7d46-496b-b845-3bb26af3fd9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:40.955622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:40.957036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:40.958029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:40.958029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:40.958029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:40.958029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:40.958029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 546/1082] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:40.963449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ae1d-7d46-496b-b845-3bb26af3fd9b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:41.023233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ddfa1-f8ff-46d7-8942-020847ec064d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:41.059758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce283f-cfa7-4cda-8052-2bc12b8cb508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:41.060637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce283f-cfa7-4cda-8052-2bc12b8cb508 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:41.060912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce283f-cfa7-4cda-8052-2bc12b8cb508 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:41.061183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce283f-cfa7-4cda-8052-2bc12b8cb508 None admin] PATH_INFO: `/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376/users/bdbc249633874f3a87b325cabb1c2af3/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:41.063133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce283f-cfa7-4cda-8052-2bc12b8cb508 None admin] RBAC: Authorizing `identity:create_grant(project_id=3da60ffeabde4bbeba4b20cb60f8f376, user_id=bdbc249633874f3a87b325cabb1c2af3, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:41.064549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce283f-cfa7-4cda-8052-2bc12b8cb508 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:41.073859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ae1d-7d46-496b-b845-3bb26af3fd9b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:41.108781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c882fd1-9586-4f44-93a8-6d461ce36fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:41.109446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c882fd1-9586-4f44-93a8-6d461ce36fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:41.109729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c882fd1-9586-4f44-93a8-6d461ce36fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:41.110005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c882fd1-9586-4f44-93a8-6d461ce36fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:41.110742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c882fd1-9586-4f44-93a8-6d461ce36fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:41.111033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c882fd1-9586-4f44-93a8-6d461ce36fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:41.112417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c882fd1-9586-4f44-93a8-6d461ce36fc2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:41.121414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 537/1083] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:40 2022] PUT /identity/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376/users/bdbc249633874f3a87b325cabb1c2af3/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:55:41.124201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 547/1084] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:42.996789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd9aba-4ce6-4159-abc0-d31a70fdc192 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:42.997321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd9aba-4ce6-4159-abc0-d31a70fdc192 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:42.997321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd9aba-4ce6-4159-abc0-d31a70fdc192 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:42.998708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 538/1085] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:43.003944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53083fe-0760-423b-9822-17e705764a62 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.004388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53083fe-0760-423b-9822-17e705764a62 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.004510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53083fe-0760-423b-9822-17e705764a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.022360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f53083fe-0760-423b-9822-17e705764a62 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:43.023642 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f53083fe-0760-423b-9822-17e705764a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:43.032414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:43.094426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 548/1086] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:43.118246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd9aba-4ce6-4159-abc0-d31a70fdc192 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.183956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:43.217559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd9aba-4ce6-4159-abc0-d31a70fdc192 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:43.251024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656d186-ce3c-4bb3-b0ca-44b3e2f0967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:43.251792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656d186-ce3c-4bb3-b0ca-44b3e2f0967f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.252072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656d186-ce3c-4bb3-b0ca-44b3e2f0967f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.252344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656d186-ce3c-4bb3-b0ca-44b3e2f0967f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.263118 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656d186-ce3c-4bb3-b0ca-44b3e2f0967f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-8656d186-ce3c-4bb3-b0ca-44b3e2f0967f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:43.271274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:43.272381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:43.273242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 539/1087] 10.222.0.13 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:43.278507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53083fe-0760-423b-9822-17e705764a62 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.365827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b63429-e3a6-4787-93cc-2cad425b74fc None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.366135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b63429-e3a6-4787-93cc-2cad425b74fc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.366374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b63429-e3a6-4787-93cc-2cad425b74fc None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.367942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 540/1088] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:43.372848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e48bf-2b6c-4524-9aea-c0bbbff622a6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.373131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e48bf-2b6c-4524-9aea-c0bbbff622a6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.373412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e48bf-2b6c-4524-9aea-c0bbbff622a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.379786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53083fe-0760-423b-9822-17e705764a62 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:43.390522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-560e48bf-2b6c-4524-9aea-c0bbbff622a6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:43.391723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-560e48bf-2b6c-4524-9aea-c0bbbff622a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:43.414038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb88ae-e192-4ff7-b8ed-d63f281c39bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:43.414702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb88ae-e192-4ff7-b8ed-d63f281c39bf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.414980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb88ae-e192-4ff7-b8ed-d63f281c39bf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.415279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb88ae-e192-4ff7-b8ed-d63f281c39bf None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.416017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb88ae-e192-4ff7-b8ed-d63f281c39bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:43.416320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb88ae-e192-4ff7-b8ed-d63f281c39bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:43.417698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb88ae-e192-4ff7-b8ed-d63f281c39bf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:43.425391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 549/1089] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:43.431576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb88ae-e192-4ff7-b8ed-d63f281c39bf None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.434909 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:43.458963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 541/1090] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:43.482760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e48bf-2b6c-4524-9aea-c0bbbff622a6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.530120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb88ae-e192-4ff7-b8ed-d63f281c39bf None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:43.538362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:43.572632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63fdcf-3ad2-4ba2-93db-6903d2db6bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:43.573419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63fdcf-3ad2-4ba2-93db-6903d2db6bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.573700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63fdcf-3ad2-4ba2-93db-6903d2db6bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.573975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63fdcf-3ad2-4ba2-93db-6903d2db6bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.578750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e48bf-2b6c-4524-9aea-c0bbbff622a6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:43.584431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63fdcf-3ad2-4ba2-93db-6903d2db6bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:43.585872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63fdcf-3ad2-4ba2-93db-6903d2db6bd9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-4e63fdcf-3ad2-4ba2-93db-6903d2db6bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:43.603517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:43.604602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:43.606012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:43.606012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:43.606012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:43.606012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:43.606012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 550/1091] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:43.610490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63fdcf-3ad2-4ba2-93db-6903d2db6bd9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.617331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453058f-8051-416e-8454-86f7ba5fd327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:43.618126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453058f-8051-416e-8454-86f7ba5fd327 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.618406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453058f-8051-416e-8454-86f7ba5fd327 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.618677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453058f-8051-416e-8454-86f7ba5fd327 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.628573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453058f-8051-416e-8454-86f7ba5fd327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-b453058f-8051-416e-8454-86f7ba5fd327 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:43.636131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:43.637140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:43.637975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:55:43.642329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 542/1092] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:43.642970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453058f-8051-416e-8454-86f7ba5fd327 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.666162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:43.710870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63fdcf-3ad2-4ba2-93db-6903d2db6bd9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:43.742093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453058f-8051-416e-8454-86f7ba5fd327 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:43.745026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0747d-2c20-4d92-b59e-2a2663fb9535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:43.745684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0747d-2c20-4d92-b59e-2a2663fb9535 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.745967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0747d-2c20-4d92-b59e-2a2663fb9535 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.746244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0747d-2c20-4d92-b59e-2a2663fb9535 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.746955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0747d-2c20-4d92-b59e-2a2663fb9535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:43.747290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0747d-2c20-4d92-b59e-2a2663fb9535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:43.748653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0747d-2c20-4d92-b59e-2a2663fb9535 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:43.758151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:43.764650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 551/1093] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:43.765684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0747d-2c20-4d92-b59e-2a2663fb9535 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.775236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbaa3b-2ee1-49e5-b817-b22dcdf998b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:43.781272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbaa3b-2ee1-49e5-b817-b22dcdf998b7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.781272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbaa3b-2ee1-49e5-b817-b22dcdf998b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.781272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbaa3b-2ee1-49e5-b817-b22dcdf998b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.781272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbaa3b-2ee1-49e5-b817-b22dcdf998b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:43.781272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbaa3b-2ee1-49e5-b817-b22dcdf998b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:43.781272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbaa3b-2ee1-49e5-b817-b22dcdf998b7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:43.787881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 543/1094] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:43.793642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbaa3b-2ee1-49e5-b817-b22dcdf998b7 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.867120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0747d-2c20-4d92-b59e-2a2663fb9535 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:43.883300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:43.889630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbaa3b-2ee1-49e5-b817-b22dcdf998b7 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:43.901397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97c07-6c76-46b5-9053-36e35ecd1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:43.902184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97c07-6c76-46b5-9053-36e35ecd1209 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.902464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97c07-6c76-46b5-9053-36e35ecd1209 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.902733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97c07-6c76-46b5-9053-36e35ecd1209 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.912785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d97c07-6c76-46b5-9053-36e35ecd1209 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:43.915155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d97c07-6c76-46b5-9053-36e35ecd1209 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:43.924413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4608327-7494-4ef8-a80e-c9952e616a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:43.925275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4608327-7494-4ef8-a80e-c9952e616a87 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:43.925555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4608327-7494-4ef8-a80e-c9952e616a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:43.925828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4608327-7494-4ef8-a80e-c9952e616a87 None admin] PATH_INFO: `/v3/users/bdbc249633874f3a87b325cabb1c2af3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:43.927023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4608327-7494-4ef8-a80e-c9952e616a87 None admin] RBAC: Authorizing `identity:get_user(user_id=bdbc249633874f3a87b325cabb1c2af3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:43.928475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4608327-7494-4ef8-a80e-c9952e616a87 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:43.930295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 544/1095] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/users/bdbc249633874f3a87b325cabb1c2af3 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-09d97c07-6c76-46b5-9053-36e35ecd1209 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:43.931053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:43.932380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:43.933611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 552/1096] 10.222.0.13 () {56 vars in 1093 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:43.935855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4608327-7494-4ef8-a80e-c9952e616a87 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.937696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97c07-6c76-46b5-9053-36e35ecd1209 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:43.985323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:44.035648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4608327-7494-4ef8-a80e-c9952e616a87 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:44.039593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97c07-6c76-46b5-9053-36e35ecd1209 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:44.069433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc365a-e5ec-4358-bfc9-33f7ba7072cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:44.070076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc365a-e5ec-4358-bfc9-33f7ba7072cd None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:44.070356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc365a-e5ec-4358-bfc9-33f7ba7072cd None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:44.070630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc365a-e5ec-4358-bfc9-33f7ba7072cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:44.072920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cebde-84b6-4852-bae0-3f5b8fbb48b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:44.073586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cebde-84b6-4852-bae0-3f5b8fbb48b5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:44.073867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cebde-84b6-4852-bae0-3f5b8fbb48b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:44.074144 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cebde-84b6-4852-bae0-3f5b8fbb48b5 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:44.074972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cebde-84b6-4852-bae0-3f5b8fbb48b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:44.075313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cebde-84b6-4852-bae0-3f5b8fbb48b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:44.076726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cebde-84b6-4852-bae0-3f5b8fbb48b5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:44.094082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 553/1097] 10.222.0.13 () {56 vars in 1133 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:44.100295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cebde-84b6-4852-bae0-3f5b8fbb48b5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:44.133041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:44.137237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc365a-e5ec-4358-bfc9-33f7ba7072cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:44.138710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc365a-e5ec-4358-bfc9-33f7ba7072cd None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:44.185147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:44.198270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cebde-84b6-4852-bae0-3f5b8fbb48b5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:44.235774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 545/1098] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:44.236074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ec3c8-0bed-44da-b881-5727003e411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:44.236717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ec3c8-0bed-44da-b881-5727003e411b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:44.236994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ec3c8-0bed-44da-b881-5727003e411b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:44.238101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ec3c8-0bed-44da-b881-5727003e411b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:44.241537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc365a-e5ec-4358-bfc9-33f7ba7072cd None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:44.305532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ec3c8-0bed-44da-b881-5727003e411b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:44.307115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ec3c8-0bed-44da-b881-5727003e411b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:44.339829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:44.342205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc365a-e5ec-4358-bfc9-33f7ba7072cd None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:44.375363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43cf87-2531-40db-b7ab-2f70e9a87439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:44.376223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43cf87-2531-40db-b7ab-2f70e9a87439 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:44.376501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43cf87-2531-40db-b7ab-2f70e9a87439 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:44.376774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43cf87-2531-40db-b7ab-2f70e9a87439 None admin] PATH_INFO: `/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:44.377940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43cf87-2531-40db-b7ab-2f70e9a87439 None admin] RBAC: Authorizing `identity:get_project(project_id=3da60ffeabde4bbeba4b20cb60f8f376)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:44.379378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43cf87-2531-40db-b7ab-2f70e9a87439 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:44.381546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 546/1099] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:44 2022] GET /identity/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:44.387480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43cf87-2531-40db-b7ab-2f70e9a87439 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:44.404715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:44.405080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 554/1100] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:44.410597 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ec3c8-0bed-44da-b881-5727003e411b None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:44.484565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43cf87-2531-40db-b7ab-2f70e9a87439 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:44.506270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ec3c8-0bed-44da-b881-5727003e411b None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:44.518407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5b5af-811e-4d68-9021-860f1abe5ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:44.519044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5b5af-811e-4d68-9021-860f1abe5ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:44.519349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5b5af-811e-4d68-9021-860f1abe5ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:44.519618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5b5af-811e-4d68-9021-860f1abe5ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:44.520434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5b5af-811e-4d68-9021-860f1abe5ce0 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=3da60ffeabde4bbeba4b20cb60f8f376, user.id=bdbc249633874f3a87b325cabb1c2af3) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:44.520739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5b5af-811e-4d68-9021-860f1abe5ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:44.522698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5b5af-811e-4d68-9021-860f1abe5ce0 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:44.528685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 547/1101] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:44 2022] GET /identity/v3/role_assignments?user.id=bdbc249633874f3a87b325cabb1c2af3&scope.project.id=3da60ffeabde4bbeba4b20cb60f8f376&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:44.540184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b678f8-0ac1-4bcb-92cf-808b44e326d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:44.541007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b678f8-0ac1-4bcb-92cf-808b44e326d8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:44.541288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b678f8-0ac1-4bcb-92cf-808b44e326d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:44.541561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b678f8-0ac1-4bcb-92cf-808b44e326d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:44.543842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:44.554018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b678f8-0ac1-4bcb-92cf-808b44e326d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:44.555525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b678f8-0ac1-4bcb-92cf-808b44e326d8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-48b678f8-0ac1-4bcb-92cf-808b44e326d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:44.575165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:44.576311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:44.582509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:44.582509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:44.582509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:44.582509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:44.582509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 555/1102] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:44.582854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5b5af-811e-4d68-9021-860f1abe5ce0 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:44.667689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:44.687811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5b5af-811e-4d68-9021-860f1abe5ce0 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:44.723935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcceb67-a3e2-4086-bf58-d93c5374c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:44.724603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcceb67-a3e2-4086-bf58-d93c5374c654 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:44.724882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcceb67-a3e2-4086-bf58-d93c5374c654 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:44.725156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcceb67-a3e2-4086-bf58-d93c5374c654 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:44.725870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcceb67-a3e2-4086-bf58-d93c5374c654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:44.726177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcceb67-a3e2-4086-bf58-d93c5374c654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:44.728168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcceb67-a3e2-4086-bf58-d93c5374c654 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:44.739558 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 548/1103] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:44.745497 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b678f8-0ac1-4bcb-92cf-808b44e326d8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:44.853505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b678f8-0ac1-4bcb-92cf-808b44e326d8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:44.882021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02688bda-06a7-4533-80a6-ae5ef8c5437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:44.882812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02688bda-06a7-4533-80a6-ae5ef8c5437d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:44.883109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02688bda-06a7-4533-80a6-ae5ef8c5437d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:44.883390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02688bda-06a7-4533-80a6-ae5ef8c5437d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:44.889963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02688bda-06a7-4533-80a6-ae5ef8c5437d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:44.891416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02688bda-06a7-4533-80a6-ae5ef8c5437d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-02688bda-06a7-4533-80a6-ae5ef8c5437d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:44.904992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:44.906067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:44.907469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:44.907469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:44.907469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:44.907469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:44.907469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:44.907469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:44.907469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:44.907469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:55:44.907469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 556/1104] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:44.912487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcceb67-a3e2-4086-bf58-d93c5374c654 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:45.009256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcceb67-a3e2-4086-bf58-d93c5374c654 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:45.042088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333361d-90d1-4ce6-932a-543082cd7c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:45.042745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333361d-90d1-4ce6-932a-543082cd7c6c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:45.043028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333361d-90d1-4ce6-932a-543082cd7c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:45.043326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333361d-90d1-4ce6-932a-543082cd7c6c None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:45.044104 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333361d-90d1-4ce6-932a-543082cd7c6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:45.044413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333361d-90d1-4ce6-932a-543082cd7c6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:45.045825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333361d-90d1-4ce6-932a-543082cd7c6c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:45.057066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:45.060420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 549/1105] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:45.066288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02688bda-06a7-4533-80a6-ae5ef8c5437d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:45.112406 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:45.167141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02688bda-06a7-4533-80a6-ae5ef8c5437d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:45.201401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065b0d-bbaf-4b7d-9111-c7969ba3a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:45.202038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065b0d-bbaf-4b7d-9111-c7969ba3a14d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:45.202313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065b0d-bbaf-4b7d-9111-c7969ba3a14d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:45.202583 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065b0d-bbaf-4b7d-9111-c7969ba3a14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:45.203461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065b0d-bbaf-4b7d-9111-c7969ba3a14d None admin] RBAC: Adding query filter params (role.id=407071ed54014753a3e4d05e5b145946, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=0b0591179ec144f5a90c9a24205b6b47) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:45.203767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065b0d-bbaf-4b7d-9111-c7969ba3a14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:45.205182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065b0d-bbaf-4b7d-9111-c7969ba3a14d None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:45.211016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 557/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:45 2022] GET /identity/v3/role_assignments?user.id=0b0591179ec144f5a90c9a24205b6b47&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=407071ed54014753a3e4d05e5b145946 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:46.779768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf987f50-25fd-4bbb-8042-cc88dc0f3e2c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:46.780300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf987f50-25fd-4bbb-8042-cc88dc0f3e2c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:46.780300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf987f50-25fd-4bbb-8042-cc88dc0f3e2c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:46.781680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 550/1107] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:46.787627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5111-add5-4425-bac6-7db9300a1912 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:46.788008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5111-add5-4425-bac6-7db9300a1912 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:46.788181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5111-add5-4425-bac6-7db9300a1912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:46.804612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2d4d5111-add5-4425-bac6-7db9300a1912 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:46.805799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2d4d5111-add5-4425-bac6-7db9300a1912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:46.871898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 558/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:46.896511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf987f50-25fd-4bbb-8042-cc88dc0f3e2c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:46.993918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf987f50-25fd-4bbb-8042-cc88dc0f3e2c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:47.026289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42da22-6d01-4964-9f20-0624d920b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:47.027057 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42da22-6d01-4964-9f20-0624d920b6cb None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:47.027367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42da22-6d01-4964-9f20-0624d920b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:47.027641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42da22-6d01-4964-9f20-0624d920b6cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:47.028799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42da22-6d01-4964-9f20-0624d920b6cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:47.030263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42da22-6d01-4964-9f20-0624d920b6cb None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:47.031831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 551/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:47.037829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5111-add5-4425-bac6-7db9300a1912 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:47.077593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:47.134679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5111-add5-4425-bac6-7db9300a1912 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:47.167573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2c906-9451-4089-92e9-61d9efca65c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:47.168229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c906-9451-4089-92e9-61d9efca65c2 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:47.168507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c906-9451-4089-92e9-61d9efca65c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:47.168780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c906-9451-4089-92e9-61d9efca65c2 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:47.169472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2c906-9451-4089-92e9-61d9efca65c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:47.170902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2c906-9451-4089-92e9-61d9efca65c2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:47.259816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 559/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:55:47 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:49.511621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9594e-f582-4d1d-95fd-3ba4f5370aa3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:49.512134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9594e-f582-4d1d-95fd-3ba4f5370aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:49.512134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9594e-f582-4d1d-95fd-3ba4f5370aa3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:49.513506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 552/1111] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:49.518876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13f9fd-ecad-49e2-9a2b-3927bc4fe400 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:49.519311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13f9fd-ecad-49e2-9a2b-3927bc4fe400 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:49.519402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13f9fd-ecad-49e2-9a2b-3927bc4fe400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:49.535588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9e13f9fd-ecad-49e2-9a2b-3927bc4fe400 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:49.537247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9e13f9fd-ecad-49e2-9a2b-3927bc4fe400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:49.605292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 560/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:49.628704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9594e-f582-4d1d-95fd-3ba4f5370aa3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:49.694319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:49.727410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9594e-f582-4d1d-95fd-3ba4f5370aa3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:49.760678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df2c5a-afa8-4754-8dfc-92a4b12cad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:49.761519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2c5a-afa8-4754-8dfc-92a4b12cad11 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:49.761800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2c5a-afa8-4754-8dfc-92a4b12cad11 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:49.762075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2c5a-afa8-4754-8dfc-92a4b12cad11 None admin] PATH_INFO: `/v3/roles/cd5bf20507a2408d8f752cc0be80f77f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:49.763556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df2c5a-afa8-4754-8dfc-92a4b12cad11 None admin] RBAC: Authorizing `identity:get_role(role_id=cd5bf20507a2408d8f752cc0be80f77f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:49.764901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df2c5a-afa8-4754-8dfc-92a4b12cad11 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:49.766236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 553/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:49 2022] GET /identity/v3/roles/cd5bf20507a2408d8f752cc0be80f77f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:49.772717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13f9fd-ecad-49e2-9a2b-3927bc4fe400 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:49.798923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:49.870586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13f9fd-ecad-49e2-9a2b-3927bc4fe400 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:49.904328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460460-3639-4021-bb6d-e9ec131c20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:49.906401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460460-3639-4021-bb6d-e9ec131c20b8 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:49.906401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460460-3639-4021-bb6d-e9ec131c20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:49.906401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460460-3639-4021-bb6d-e9ec131c20b8 None admin] PATH_INFO: `/v3/users/b8e56f0de87c4796a14acda08ba2b465` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:49.919191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab460460-3639-4021-bb6d-e9ec131c20b8 None admin] RBAC: Authorizing `identity:get_user(user_id=b8e56f0de87c4796a14acda08ba2b465)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:49.920627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab460460-3639-4021-bb6d-e9ec131c20b8 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:49.922250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 561/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:49 2022] GET /identity/v3/users/b8e56f0de87c4796a14acda08ba2b465 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:49.927997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df2c5a-afa8-4754-8dfc-92a4b12cad11 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:50.041343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df2c5a-afa8-4754-8dfc-92a4b12cad11 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:50.073527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757f08c-d01b-4dd1-a0ea-9356567baca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:50.074166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f08c-d01b-4dd1-a0ea-9356567baca8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:50.074448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f08c-d01b-4dd1-a0ea-9356567baca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:50.074720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f08c-d01b-4dd1-a0ea-9356567baca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:50.078065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:50.141049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757f08c-d01b-4dd1-a0ea-9356567baca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:50.142478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757f08c-d01b-4dd1-a0ea-9356567baca8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:50.236555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 554/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:50.242275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460460-3639-4021-bb6d-e9ec131c20b8 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:50.325231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:50.341383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460460-3639-4021-bb6d-e9ec131c20b8 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:50.374448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed88bf-44fa-4911-8182-164964e827de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:50.375320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed88bf-44fa-4911-8182-164964e827de None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:50.375602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed88bf-44fa-4911-8182-164964e827de None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:50.375872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed88bf-44fa-4911-8182-164964e827de None admin] PATH_INFO: `/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:50.377049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed88bf-44fa-4911-8182-164964e827de None admin] RBAC: Authorizing `identity:get_project(project_id=3da60ffeabde4bbeba4b20cb60f8f376)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:50.378466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed88bf-44fa-4911-8182-164964e827de None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:50.380685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 562/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:50 2022] GET /identity/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:50.386683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757f08c-d01b-4dd1-a0ea-9356567baca8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:50.419899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:50.482687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757f08c-d01b-4dd1-a0ea-9356567baca8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:50.515174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe571fd-7fae-41b2-8124-b439bc7bddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:50.515820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe571fd-7fae-41b2-8124-b439bc7bddac None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:50.516101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe571fd-7fae-41b2-8124-b439bc7bddac None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:50.516375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe571fd-7fae-41b2-8124-b439bc7bddac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:50.517197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe571fd-7fae-41b2-8124-b439bc7bddac None admin] RBAC: Adding query filter params (role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=3da60ffeabde4bbeba4b20cb60f8f376, user.id=b8e56f0de87c4796a14acda08ba2b465) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:50.517507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe571fd-7fae-41b2-8124-b439bc7bddac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:50.518909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe571fd-7fae-41b2-8124-b439bc7bddac None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:50.524798 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 555/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:50 2022] GET /identity/v3/role_assignments?user.id=b8e56f0de87c4796a14acda08ba2b465&scope.project.id=3da60ffeabde4bbeba4b20cb60f8f376&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:52.711373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53b9c-6c0a-4cd6-b2b4-8c0e417ec7dd None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:52.711901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53b9c-6c0a-4cd6-b2b4-8c0e417ec7dd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:52.711901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53b9c-6c0a-4cd6-b2b4-8c0e417ec7dd None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:52.713548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 563/1118] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:52.718857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610bfdc-1d6c-4910-ab0c-a9ec642ef63b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:52.719334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610bfdc-1d6c-4910-ab0c-a9ec642ef63b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:52.719434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610bfdc-1d6c-4910-ab0c-a9ec642ef63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:52.735770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d610bfdc-1d6c-4910-ab0c-a9ec642ef63b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:52.736960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d610bfdc-1d6c-4910-ab0c-a9ec642ef63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:52.800406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 556/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:52.823348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f53b9c-6c0a-4cd6-b2b4-8c0e417ec7dd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:52.921731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f53b9c-6c0a-4cd6-b2b4-8c0e417ec7dd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:52.954980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891243e-c1f8-4f4a-ae9e-0d7e6a0cc354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:52.955844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891243e-c1f8-4f4a-ae9e-0d7e6a0cc354 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:52.956131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891243e-c1f8-4f4a-ae9e-0d7e6a0cc354 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:52.956403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891243e-c1f8-4f4a-ae9e-0d7e6a0cc354 None admin] PATH_INFO: `/v3/roles/cd5bf20507a2408d8f752cc0be80f77f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:52.957882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891243e-c1f8-4f4a-ae9e-0d7e6a0cc354 None admin] RBAC: Authorizing `identity:get_role(role_id=cd5bf20507a2408d8f752cc0be80f77f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:52.959341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891243e-c1f8-4f4a-ae9e-0d7e6a0cc354 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:52.960695 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 564/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:52 2022] GET /identity/v3/roles/cd5bf20507a2408d8f752cc0be80f77f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:52.966637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610bfdc-1d6c-4910-ab0c-a9ec642ef63b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:52.995101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:53.061011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610bfdc-1d6c-4910-ab0c-a9ec642ef63b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:53.093543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74b50b-e94e-44cd-9d17-667fac78adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:53.094398 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74b50b-e94e-44cd-9d17-667fac78adf4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:53.094675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74b50b-e94e-44cd-9d17-667fac78adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:53.094942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74b50b-e94e-44cd-9d17-667fac78adf4 None admin] PATH_INFO: `/v3/users/b8e56f0de87c4796a14acda08ba2b465` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:53.096114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74b50b-e94e-44cd-9d17-667fac78adf4 None admin] RBAC: Authorizing `identity:get_user(user_id=b8e56f0de87c4796a14acda08ba2b465)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:53.097510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74b50b-e94e-44cd-9d17-667fac78adf4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:53.099131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 557/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:52 2022] GET /identity/v3/users/b8e56f0de87c4796a14acda08ba2b465 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:53.104692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891243e-c1f8-4f4a-ae9e-0d7e6a0cc354 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:53.126414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:53.202204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891243e-c1f8-4f4a-ae9e-0d7e6a0cc354 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:53.235023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce6874-e668-4353-9391-9ee674af61cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:53.235825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce6874-e668-4353-9391-9ee674af61cf None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:53.236107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce6874-e668-4353-9391-9ee674af61cf None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:53.236380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce6874-e668-4353-9391-9ee674af61cf None admin] PATH_INFO: `/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:53.237542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce6874-e668-4353-9391-9ee674af61cf None admin] RBAC: Authorizing `identity:get_project(project_id=3da60ffeabde4bbeba4b20cb60f8f376)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:53.238971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce6874-e668-4353-9391-9ee674af61cf None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:53.241231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 565/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:53 2022] GET /identity/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:53.247061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74b50b-e94e-44cd-9d17-667fac78adf4 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:53.339419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:53.342846 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74b50b-e94e-44cd-9d17-667fac78adf4 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:53.376068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc01eb7-b461-4e8a-b597-f1a5ab5b3b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:53.376945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01eb7-b461-4e8a-b597-f1a5ab5b3b85 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:53.377227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01eb7-b461-4e8a-b597-f1a5ab5b3b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:53.377562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01eb7-b461-4e8a-b597-f1a5ab5b3b85 None admin] PATH_INFO: `/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376/users/b8e56f0de87c4796a14acda08ba2b465/roles/cd5bf20507a2408d8f752cc0be80f77f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:53.380254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc01eb7-b461-4e8a-b597-f1a5ab5b3b85 None admin] RBAC: Authorizing `identity:create_grant(project_id=3da60ffeabde4bbeba4b20cb60f8f376, user_id=b8e56f0de87c4796a14acda08ba2b465, role_id=cd5bf20507a2408d8f752cc0be80f77f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:53.381677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc01eb7-b461-4e8a-b597-f1a5ab5b3b85 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:53.458222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 558/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:53 2022] PUT /identity/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376/users/b8e56f0de87c4796a14acda08ba2b465/roles/cd5bf20507a2408d8f752cc0be80f77f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:55:55.656967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf931a-3d20-4c3a-87af-ac5c57474fac None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:55.657491 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf931a-3d20-4c3a-87af-ac5c57474fac None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:55.657603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf931a-3d20-4c3a-87af-ac5c57474fac None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:55.658969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 566/1124] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:55.664370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835dc1f-81db-4159-9808-9c4d0f3fd1f7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:55.664771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835dc1f-81db-4159-9808-9c4d0f3fd1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:55.664924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835dc1f-81db-4159-9808-9c4d0f3fd1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:55.680713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7835dc1f-81db-4159-9808-9c4d0f3fd1f7 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:55.681879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7835dc1f-81db-4159-9808-9c4d0f3fd1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:55.746607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 559/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:55.770629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf931a-3d20-4c3a-87af-ac5c57474fac None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:55.857688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:55.870292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf931a-3d20-4c3a-87af-ac5c57474fac None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:55.902044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c81a2-e1bb-4d14-9431-d3d05df08c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:55.902942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c81a2-e1bb-4d14-9431-d3d05df08c23 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:55.903255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c81a2-e1bb-4d14-9431-d3d05df08c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:55.903524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c81a2-e1bb-4d14-9431-d3d05df08c23 None admin] PATH_INFO: `/v3/roles/cd5bf20507a2408d8f752cc0be80f77f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:55.904959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c81a2-e1bb-4d14-9431-d3d05df08c23 None admin] RBAC: Authorizing `identity:get_role(role_id=cd5bf20507a2408d8f752cc0be80f77f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:55.906297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c81a2-e1bb-4d14-9431-d3d05df08c23 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:55.907710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 567/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:55 2022] GET /identity/v3/roles/cd5bf20507a2408d8f752cc0be80f77f => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:55.913269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835dc1f-81db-4159-9808-9c4d0f3fd1f7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:55.997836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:56.009647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835dc1f-81db-4159-9808-9c4d0f3fd1f7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:56.043261 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe045090-f5dc-43a6-927f-1fc35cab5b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:56.044118 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe045090-f5dc-43a6-927f-1fc35cab5b3f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:56.044397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe045090-f5dc-43a6-927f-1fc35cab5b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:56.044670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe045090-f5dc-43a6-927f-1fc35cab5b3f None admin] PATH_INFO: `/v3/users/b8e56f0de87c4796a14acda08ba2b465` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:56.045834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe045090-f5dc-43a6-927f-1fc35cab5b3f None admin] RBAC: Authorizing `identity:get_user(user_id=b8e56f0de87c4796a14acda08ba2b465)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:56.047279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe045090-f5dc-43a6-927f-1fc35cab5b3f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:56.048909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 560/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:55 2022] GET /identity/v3/users/b8e56f0de87c4796a14acda08ba2b465 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:56.054477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c81a2-e1bb-4d14-9431-d3d05df08c23 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:56.151555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c81a2-e1bb-4d14-9431-d3d05df08c23 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:56.183749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5b135-54c8-4414-82d3-04aef0acfa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:56.184323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5b135-54c8-4414-82d3-04aef0acfa34 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:56.184606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5b135-54c8-4414-82d3-04aef0acfa34 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:56.184884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5b135-54c8-4414-82d3-04aef0acfa34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:56.209206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:56.250117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5b135-54c8-4414-82d3-04aef0acfa34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:56.251585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5b135-54c8-4414-82d3-04aef0acfa34 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:56.347032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 568/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:56.352829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe045090-f5dc-43a6-927f-1fc35cab5b3f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:56.447035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe045090-f5dc-43a6-927f-1fc35cab5b3f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:56.479252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fe6d6-cd88-4eb4-ad2a-9cda075e9a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:56.480085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fe6d6-cd88-4eb4-ad2a-9cda075e9a78 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:56.480358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fe6d6-cd88-4eb4-ad2a-9cda075e9a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:56.480623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fe6d6-cd88-4eb4-ad2a-9cda075e9a78 None admin] PATH_INFO: `/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:56.481781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fe6d6-cd88-4eb4-ad2a-9cda075e9a78 None admin] RBAC: Authorizing `identity:get_project(project_id=3da60ffeabde4bbeba4b20cb60f8f376)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:56.483202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fe6d6-cd88-4eb4-ad2a-9cda075e9a78 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:56.484831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 561/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:56 2022] GET /identity/v3/projects/3da60ffeabde4bbeba4b20cb60f8f376 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:56.491239 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5b135-54c8-4414-82d3-04aef0acfa34 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:56.544498 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:56.586848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5b135-54c8-4414-82d3-04aef0acfa34 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:56.619881 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746950e-89c6-45ab-9796-8ed853906435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:56.620516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746950e-89c6-45ab-9796-8ed853906435 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:56.620799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746950e-89c6-45ab-9796-8ed853906435 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:56.621074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746950e-89c6-45ab-9796-8ed853906435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:56.621897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746950e-89c6-45ab-9796-8ed853906435 None admin] RBAC: Adding query filter params (role.id=cd5bf20507a2408d8f752cc0be80f77f, scope.project.id=3da60ffeabde4bbeba4b20cb60f8f376, user.id=b8e56f0de87c4796a14acda08ba2b465) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:56.622210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746950e-89c6-45ab-9796-8ed853906435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:56.623654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746950e-89c6-45ab-9796-8ed853906435 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:56.629303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 569/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:56 2022] GET /identity/v3/role_assignments?user.id=b8e56f0de87c4796a14acda08ba2b465&scope.project.id=3da60ffeabde4bbeba4b20cb60f8f376&role.id=cd5bf20507a2408d8f752cc0be80f77f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:58.829010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109675-028b-4cec-b4f8-3f66f29b9c5c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:58.829543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109675-028b-4cec-b4f8-3f66f29b9c5c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:58.829543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109675-028b-4cec-b4f8-3f66f29b9c5c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:58.830895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 562/1131] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:58.836540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c1de8-958f-4b39-8835-f23fb5665eb4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:58.836965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c1de8-958f-4b39-8835-f23fb5665eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:58.837090 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c1de8-958f-4b39-8835-f23fb5665eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:58.854257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-441c1de8-958f-4b39-8835-f23fb5665eb4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:58.855463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-441c1de8-958f-4b39-8835-f23fb5665eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:58.922476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 570/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:58.945518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60109675-028b-4cec-b4f8-3f66f29b9c5c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:58.970693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:59.044499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60109675-028b-4cec-b4f8-3f66f29b9c5c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:59.076453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4d8a0-f44a-4356-9393-e8fa92d229f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:59.077226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4d8a0-f44a-4356-9393-e8fa92d229f3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:59.077507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4d8a0-f44a-4356-9393-e8fa92d229f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:59.077780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4d8a0-f44a-4356-9393-e8fa92d229f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:59.078930 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4d8a0-f44a-4356-9393-e8fa92d229f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:59.080418 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4d8a0-f44a-4356-9393-e8fa92d229f3 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:59.081951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 563/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:59.088409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c1de8-958f-4b39-8835-f23fb5665eb4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:59.136631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:59.184941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c1de8-958f-4b39-8835-f23fb5665eb4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:59.221971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226dd4f-7919-407d-b4ed-327e015a9dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:59.222611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226dd4f-7919-407d-b4ed-327e015a9dd0 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:59.222887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226dd4f-7919-407d-b4ed-327e015a9dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:59.223212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226dd4f-7919-407d-b4ed-327e015a9dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:59.223904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226dd4f-7919-407d-b4ed-327e015a9dd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:59.225298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226dd4f-7919-407d-b4ed-327e015a9dd0 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:59.325782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 571/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:59 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:56:01.578541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6bc47-522e-4665-8192-18c6577ab28c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:01.579134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6bc47-522e-4665-8192-18c6577ab28c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:01.579134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6bc47-522e-4665-8192-18c6577ab28c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:01.580465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 564/1135] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:01.585807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6c02-fa10-413d-9b6c-18b16a404f69 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:01.586208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6c02-fa10-413d-9b6c-18b16a404f69 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:01.586352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6c02-fa10-413d-9b6c-18b16a404f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:01.602892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3eee6c02-fa10-413d-9b6c-18b16a404f69 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:01.604081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3eee6c02-fa10-413d-9b6c-18b16a404f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:01.667321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 572/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:01.692131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6bc47-522e-4665-8192-18c6577ab28c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:01.780046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:01.789644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6bc47-522e-4665-8192-18c6577ab28c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:01.822350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6562640-8797-4360-b6ab-4bf053259e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:01.823141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6562640-8797-4360-b6ab-4bf053259e95 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:01.823423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6562640-8797-4360-b6ab-4bf053259e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:01.823695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6562640-8797-4360-b6ab-4bf053259e95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:01.824844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6562640-8797-4360-b6ab-4bf053259e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:01.826244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6562640-8797-4360-b6ab-4bf053259e95 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:01.827847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 565/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:56:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:01.833480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee6c02-fa10-413d-9b6c-18b16a404f69 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:01.862968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:01.929139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee6c02-fa10-413d-9b6c-18b16a404f69 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:01.960989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae40b35-4b8b-4d8e-ac27-e00e895ea338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:01.961641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae40b35-4b8b-4d8e-ac27-e00e895ea338 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:01.961916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae40b35-4b8b-4d8e-ac27-e00e895ea338 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:01.962451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae40b35-4b8b-4d8e-ac27-e00e895ea338 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:01.963173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae40b35-4b8b-4d8e-ac27-e00e895ea338 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:01.964640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae40b35-4b8b-4d8e-ac27-e00e895ea338 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:02.068942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 573/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:56:01 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:56:04.307555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1f9f-ab7d-4750-ac9a-d34e05d33e9f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:04.308074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1f9f-ab7d-4750-ac9a-d34e05d33e9f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:04.308074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1f9f-ab7d-4750-ac9a-d34e05d33e9f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:04.309458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 566/1139] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:04.314613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea179835-88ff-4c1d-8407-8c1cb8cfa76b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:04.314994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea179835-88ff-4c1d-8407-8c1cb8cfa76b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:04.315189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea179835-88ff-4c1d-8407-8c1cb8cfa76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:04.332532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ea179835-88ff-4c1d-8407-8c1cb8cfa76b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:04.333688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ea179835-88ff-4c1d-8407-8c1cb8cfa76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:04.396878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 574/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:04.419967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1f9f-ab7d-4750-ac9a-d34e05d33e9f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:04.517902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1f9f-ab7d-4750-ac9a-d34e05d33e9f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:04.549517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba9c8e-fe40-4051-9cdf-1b3a4c68c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:04.550291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9c8e-fe40-4051-9cdf-1b3a4c68c63f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:04.551116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9c8e-fe40-4051-9cdf-1b3a4c68c63f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:04.551390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9c8e-fe40-4051-9cdf-1b3a4c68c63f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:04.561053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba9c8e-fe40-4051-9cdf-1b3a4c68c63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-25ba9c8e-fe40-4051-9cdf-1b3a4c68c63f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:04.569145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:04.570225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:56:04.571294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 567/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:04.576249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea179835-88ff-4c1d-8407-8c1cb8cfa76b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:04.594275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:04.672390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea179835-88ff-4c1d-8407-8c1cb8cfa76b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:04.705533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ec38-b538-433d-be7f-796b23242ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:04.706182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ec38-b538-433d-be7f-796b23242ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:04.706461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ec38-b538-433d-be7f-796b23242ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:04.706734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ec38-b538-433d-be7f-796b23242ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:04.707498 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36ec38-b538-433d-be7f-796b23242ec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:04.707802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36ec38-b538-433d-be7f-796b23242ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:04.709186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36ec38-b538-433d-be7f-796b23242ec5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:04.717166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 575/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:04.722745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba9c8e-fe40-4051-9cdf-1b3a4c68c63f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:04.744605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:04.819905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba9c8e-fe40-4051-9cdf-1b3a4c68c63f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:04.852210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763d130-1ba2-4674-8b5a-875ef065330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:04.853055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763d130-1ba2-4674-8b5a-875ef065330d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:04.853331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763d130-1ba2-4674-8b5a-875ef065330d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:04.853597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763d130-1ba2-4674-8b5a-875ef065330d None admin] PATH_INFO: `/v3/users/1d5534d687864f0a93c2364d4c4b790c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:04.866715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763d130-1ba2-4674-8b5a-875ef065330d None admin] RBAC: Authorizing `identity:get_user(user_id=1d5534d687864f0a93c2364d4c4b790c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:04.868168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763d130-1ba2-4674-8b5a-875ef065330d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:04.869778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 568/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:04 2022] GET /identity/v3/users/1d5534d687864f0a93c2364d4c4b790c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:04.875688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ec38-b538-433d-be7f-796b23242ec5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:04.955717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:04.974776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ec38-b538-433d-be7f-796b23242ec5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:05.009032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a2a96-ea67-41da-9a76-1b100b82a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:05.009667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a2a96-ea67-41da-9a76-1b100b82a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:05.009949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a2a96-ea67-41da-9a76-1b100b82a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:05.010225 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a2a96-ea67-41da-9a76-1b100b82a3e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:05.075205 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a2a96-ea67-41da-9a76-1b100b82a3e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:05.076593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a2a96-ea67-41da-9a76-1b100b82a3e9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:05.152520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:05.172222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 576/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:56:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:56:05.178210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763d130-1ba2-4674-8b5a-875ef065330d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:05.252427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:05.273571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763d130-1ba2-4674-8b5a-875ef065330d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:05.306635 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731b359-eed9-44e7-8021-d443399f8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:05.307511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b359-eed9-44e7-8021-d443399f8ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:05.307788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b359-eed9-44e7-8021-d443399f8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:05.308276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b359-eed9-44e7-8021-d443399f8ea1 None admin] PATH_INFO: `/v3/projects/b97e176c6bd54ce9aed1b354bcb8ced4` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:05.309236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731b359-eed9-44e7-8021-d443399f8ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=b97e176c6bd54ce9aed1b354bcb8ced4)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:05.310692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731b359-eed9-44e7-8021-d443399f8ea1 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:05.312584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 569/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:05 2022] GET /identity/v3/projects/b97e176c6bd54ce9aed1b354bcb8ced4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:05.318617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a2a96-ea67-41da-9a76-1b100b82a3e9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:05.414563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a2a96-ea67-41da-9a76-1b100b82a3e9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:05.446975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee2570-0e92-424c-b31a-9cabff48485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:05.447640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee2570-0e92-424c-b31a-9cabff48485b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:05.447921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee2570-0e92-424c-b31a-9cabff48485b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:05.448195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee2570-0e92-424c-b31a-9cabff48485b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:05.449012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee2570-0e92-424c-b31a-9cabff48485b None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=b97e176c6bd54ce9aed1b354bcb8ced4, user.id=1d5534d687864f0a93c2364d4c4b790c) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:05.449320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee2570-0e92-424c-b31a-9cabff48485b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:05.450731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee2570-0e92-424c-b31a-9cabff48485b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:05.456069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 577/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:56:05 2022] GET /identity/v3/role_assignments?user.id=1d5534d687864f0a93c2364d4c4b790c&scope.project.id=b97e176c6bd54ce9aed1b354bcb8ced4&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:07.642430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757a88-0955-4cb7-bc50-b8f63a1324ce None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:07.642950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757a88-0955-4cb7-bc50-b8f63a1324ce None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:07.643042 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e757a88-0955-4cb7-bc50-b8f63a1324ce None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:07.644427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 570/1147] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:07.649841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcdaa-f307-4b59-ac9b-d1084fd3758a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:07.650249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcdaa-f307-4b59-ac9b-d1084fd3758a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:07.650391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcdaa-f307-4b59-ac9b-d1084fd3758a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:07.666627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c16fcdaa-f307-4b59-ac9b-d1084fd3758a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:07.667816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c16fcdaa-f307-4b59-ac9b-d1084fd3758a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:07.712971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:07.738399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 578/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:07.761322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e757a88-0955-4cb7-bc50-b8f63a1324ce None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:07.859538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e757a88-0955-4cb7-bc50-b8f63a1324ce None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:07.892138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da2c80-f01d-47d1-bce7-c484d92246ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:07.892967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da2c80-f01d-47d1-bce7-c484d92246ea None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:07.893204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da2c80-f01d-47d1-bce7-c484d92246ea None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:07.893478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da2c80-f01d-47d1-bce7-c484d92246ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:07.903344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da2c80-f01d-47d1-bce7-c484d92246ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-26da2c80-f01d-47d1-bce7-c484d92246ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:07.911484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:07.912590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:56:07.913638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 571/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:07.918485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fcdaa-f307-4b59-ac9b-d1084fd3758a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:08.014707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fcdaa-f307-4b59-ac9b-d1084fd3758a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:08.047441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d180c-0bf1-47e2-bdf4-f8fbc75029da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:08.048092 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d180c-0bf1-47e2-bdf4-f8fbc75029da None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:08.048393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d180c-0bf1-47e2-bdf4-f8fbc75029da None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:08.048668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d180c-0bf1-47e2-bdf4-f8fbc75029da None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:08.049403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d180c-0bf1-47e2-bdf4-f8fbc75029da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:08.049710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d180c-0bf1-47e2-bdf4-f8fbc75029da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:08.051739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d180c-0bf1-47e2-bdf4-f8fbc75029da None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:08.059568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 579/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:08.065161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da2c80-f01d-47d1-bce7-c484d92246ea None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:08.074206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:08.163534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da2c80-f01d-47d1-bce7-c484d92246ea None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:08.195329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5667d-a60c-4f56-8c6b-de8937197fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:08.196184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5667d-a60c-4f56-8c6b-de8937197fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:08.196464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5667d-a60c-4f56-8c6b-de8937197fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:08.196735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5667d-a60c-4f56-8c6b-de8937197fa6 None admin] PATH_INFO: `/v3/users/1d5534d687864f0a93c2364d4c4b790c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:08.197918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5667d-a60c-4f56-8c6b-de8937197fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=1d5534d687864f0a93c2364d4c4b790c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:08.199351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5667d-a60c-4f56-8c6b-de8937197fa6 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:08.200940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 572/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:08 2022] GET /identity/v3/users/1d5534d687864f0a93c2364d4c4b790c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:08.207011 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d180c-0bf1-47e2-bdf4-f8fbc75029da None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:08.241331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:08.303627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d180c-0bf1-47e2-bdf4-f8fbc75029da None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:08.335366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda39df4-03e0-4fb0-9516-9bd0ed43278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:08.336205 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda39df4-03e0-4fb0-9516-9bd0ed43278a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:08.336741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda39df4-03e0-4fb0-9516-9bd0ed43278a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:08.337008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda39df4-03e0-4fb0-9516-9bd0ed43278a None admin] PATH_INFO: `/v3/projects/b97e176c6bd54ce9aed1b354bcb8ced4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:08.338154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda39df4-03e0-4fb0-9516-9bd0ed43278a None admin] RBAC: Authorizing `identity:get_project(project_id=b97e176c6bd54ce9aed1b354bcb8ced4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:08.339600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda39df4-03e0-4fb0-9516-9bd0ed43278a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:08.341246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 580/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:08 2022] GET /identity/v3/projects/b97e176c6bd54ce9aed1b354bcb8ced4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:08.347765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5667d-a60c-4f56-8c6b-de8937197fa6 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:08.419380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:08.442405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5667d-a60c-4f56-8c6b-de8937197fa6 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:08.475495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ea51c-89bb-483c-8e0d-0cd2cc767072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:08.476369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ea51c-89bb-483c-8e0d-0cd2cc767072 None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:08.476652 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ea51c-89bb-483c-8e0d-0cd2cc767072 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:08.476929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ea51c-89bb-483c-8e0d-0cd2cc767072 None admin] PATH_INFO: `/v3/projects/b97e176c6bd54ce9aed1b354bcb8ced4/users/1d5534d687864f0a93c2364d4c4b790c/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:08.478848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ea51c-89bb-483c-8e0d-0cd2cc767072 None admin] RBAC: Authorizing `identity:create_grant(project_id=b97e176c6bd54ce9aed1b354bcb8ced4, user_id=1d5534d687864f0a93c2364d4c4b790c, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:08.480355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ea51c-89bb-483c-8e0d-0cd2cc767072 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:08.594100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 573/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:56:08 2022] PUT /identity/v3/projects/b97e176c6bd54ce9aed1b354bcb8ced4/users/1d5534d687864f0a93c2364d4c4b790c/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:56:10.775576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c73aa-0dc7-44de-b89f-b15246b4e8c9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:10.776155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c73aa-0dc7-44de-b89f-b15246b4e8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:10.776155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c73aa-0dc7-44de-b89f-b15246b4e8c9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:10.777536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 581/1154] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:10.782732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cb148-4990-434b-83d0-a6d46d2e96c6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:10.783179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cb148-4990-434b-83d0-a6d46d2e96c6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:10.783318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cb148-4990-434b-83d0-a6d46d2e96c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:10.800726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-281cb148-4990-434b-83d0-a6d46d2e96c6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:10.801896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-281cb148-4990-434b-83d0-a6d46d2e96c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:10.865872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 574/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:10.889345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c73aa-0dc7-44de-b89f-b15246b4e8c9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:10.998380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c73aa-0dc7-44de-b89f-b15246b4e8c9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:11.000636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:11.030095 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b699c0-5f5a-49d0-a644-4064917d1aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:11.030812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b699c0-5f5a-49d0-a644-4064917d1aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:11.031108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b699c0-5f5a-49d0-a644-4064917d1aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:11.031383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b699c0-5f5a-49d0-a644-4064917d1aa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:11.042043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b699c0-5f5a-49d0-a644-4064917d1aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c8b699c0-5f5a-49d0-a644-4064917d1aa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:11.049474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:11.051218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:56:11.052353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 582/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:11.057130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cb148-4990-434b-83d0-a6d46d2e96c6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:11.117035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:11.152392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cb148-4990-434b-83d0-a6d46d2e96c6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:11.184803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df41c1a-3704-4a89-a74d-5ce05161b277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:11.185449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df41c1a-3704-4a89-a74d-5ce05161b277 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:11.185725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df41c1a-3704-4a89-a74d-5ce05161b277 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:11.185988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df41c1a-3704-4a89-a74d-5ce05161b277 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:11.186712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df41c1a-3704-4a89-a74d-5ce05161b277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:11.187010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df41c1a-3704-4a89-a74d-5ce05161b277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:11.188363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df41c1a-3704-4a89-a74d-5ce05161b277 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:11.198427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 575/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:11.203971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b699c0-5f5a-49d0-a644-4064917d1aa9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:11.301531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b699c0-5f5a-49d0-a644-4064917d1aa9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:11.333730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee47d83-2321-481d-ab5e-178825a23094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:11.334581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee47d83-2321-481d-ab5e-178825a23094 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:11.334861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee47d83-2321-481d-ab5e-178825a23094 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:11.335156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee47d83-2321-481d-ab5e-178825a23094 None admin] PATH_INFO: `/v3/users/1d5534d687864f0a93c2364d4c4b790c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:11.336598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee47d83-2321-481d-ab5e-178825a23094 None admin] RBAC: Authorizing `identity:get_user(user_id=1d5534d687864f0a93c2364d4c4b790c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:11.338032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee47d83-2321-481d-ab5e-178825a23094 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:11.339671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 583/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:11 2022] GET /identity/v3/users/1d5534d687864f0a93c2364d4c4b790c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:11.345397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df41c1a-3704-4a89-a74d-5ce05161b277 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:11.440768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df41c1a-3704-4a89-a74d-5ce05161b277 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:11.464935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:11.473548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7aa82-479f-4565-98c0-e54debf40c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:11.474174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7aa82-479f-4565-98c0-e54debf40c47 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:11.474451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7aa82-479f-4565-98c0-e54debf40c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:11.478309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7aa82-479f-4565-98c0-e54debf40c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:11.538784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7aa82-479f-4565-98c0-e54debf40c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:11.540227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7aa82-479f-4565-98c0-e54debf40c47 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:11.633265 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 576/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:56:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:56:11.638887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee47d83-2321-481d-ab5e-178825a23094 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:11.670124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:11.736538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee47d83-2321-481d-ab5e-178825a23094 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:11.769884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036a070-5f3e-4eae-9f0c-70be2add3200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:11.770730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036a070-5f3e-4eae-9f0c-70be2add3200 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:11.771011 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036a070-5f3e-4eae-9f0c-70be2add3200 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:11.771313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036a070-5f3e-4eae-9f0c-70be2add3200 None admin] PATH_INFO: `/v3/projects/b97e176c6bd54ce9aed1b354bcb8ced4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:11.772473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036a070-5f3e-4eae-9f0c-70be2add3200 None admin] RBAC: Authorizing `identity:get_project(project_id=b97e176c6bd54ce9aed1b354bcb8ced4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:11.773883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036a070-5f3e-4eae-9f0c-70be2add3200 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:11.775583 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 584/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:11 2022] GET /identity/v3/projects/b97e176c6bd54ce9aed1b354bcb8ced4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:11.781457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7aa82-479f-4565-98c0-e54debf40c47 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:11.807047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:11.876138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7aa82-479f-4565-98c0-e54debf40c47 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:11.909089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7634faf-3f10-4482-b724-6a56b7e4a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:11.909645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7634faf-3f10-4482-b724-6a56b7e4a5aa None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:11.909922 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7634faf-3f10-4482-b724-6a56b7e4a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:11.910191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7634faf-3f10-4482-b724-6a56b7e4a5aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:11.911003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7634faf-3f10-4482-b724-6a56b7e4a5aa None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=b97e176c6bd54ce9aed1b354bcb8ced4, user.id=1d5534d687864f0a93c2364d4c4b790c) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:11.911344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7634faf-3f10-4482-b724-6a56b7e4a5aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:11.912738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7634faf-3f10-4482-b724-6a56b7e4a5aa None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:11.918322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 577/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:56:11 2022] GET /identity/v3/role_assignments?user.id=1d5534d687864f0a93c2364d4c4b790c&scope.project.id=b97e176c6bd54ce9aed1b354bcb8ced4&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:14.149593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52d3a-74a2-440c-9d48-8c132b44ebb9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:14.150220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52d3a-74a2-440c-9d48-8c132b44ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:14.150220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52d3a-74a2-440c-9d48-8c132b44ebb9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:14.151577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 585/1162] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:14.157028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da177ee-35bb-4832-be46-31b1bb7f9148 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:14.157470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da177ee-35bb-4832-be46-31b1bb7f9148 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:14.157571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da177ee-35bb-4832-be46-31b1bb7f9148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:14.174339 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5da177ee-35bb-4832-be46-31b1bb7f9148 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:14.175524 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5da177ee-35bb-4832-be46-31b1bb7f9148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:14.238625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 578/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:14.260421 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52d3a-74a2-440c-9d48-8c132b44ebb9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:14.365785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:14.369323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52d3a-74a2-440c-9d48-8c132b44ebb9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:14.401925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7416646-f4a7-4e7e-9de3-cb7f901d38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:14.402505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7416646-f4a7-4e7e-9de3-cb7f901d38ec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:14.402783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7416646-f4a7-4e7e-9de3-cb7f901d38ec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:14.403054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7416646-f4a7-4e7e-9de3-cb7f901d38ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:14.467853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7416646-f4a7-4e7e-9de3-cb7f901d38ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:14.469275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7416646-f4a7-4e7e-9de3-cb7f901d38ec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:14.561151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:14.564644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 586/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:56:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:56:14.571410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da177ee-35bb-4832-be46-31b1bb7f9148 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:14.592562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:14.668675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da177ee-35bb-4832-be46-31b1bb7f9148 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:14.701653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05146197-d636-4846-bc7c-3cb4771c557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:14.702440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05146197-d636-4846-bc7c-3cb4771c557f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:14.702722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05146197-d636-4846-bc7c-3cb4771c557f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:14.702992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05146197-d636-4846-bc7c-3cb4771c557f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:14.710074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05146197-d636-4846-bc7c-3cb4771c557f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:14.711952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05146197-d636-4846-bc7c-3cb4771c557f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-05146197-d636-4846-bc7c-3cb4771c557f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:14.725721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:14.727007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:56:14.728173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 579/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:56:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:14.732877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7416646-f4a7-4e7e-9de3-cb7f901d38ec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:14.826321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7416646-f4a7-4e7e-9de3-cb7f901d38ec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:14.858659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812f86a-2214-47e5-a3e0-3c4f0c1ad4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:14.859326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812f86a-2214-47e5-a3e0-3c4f0c1ad4bb None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:14.859609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812f86a-2214-47e5-a3e0-3c4f0c1ad4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:14.859876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812f86a-2214-47e5-a3e0-3c4f0c1ad4bb None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:14.860571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812f86a-2214-47e5-a3e0-3c4f0c1ad4bb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:14.860866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812f86a-2214-47e5-a3e0-3c4f0c1ad4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:14.862240 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812f86a-2214-47e5-a3e0-3c4f0c1ad4bb None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:14.869087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 587/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Thu Jun 2 09:56:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:17.043273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6547-9e9e-4a35-abbc-cc9a98dba01e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:17.043856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6547-9e9e-4a35-abbc-cc9a98dba01e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:17.043856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6547-9e9e-4a35-abbc-cc9a98dba01e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:17.045183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 580/1167] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:17.050959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dbdc0-7a37-45c5-a670-413ae1655423 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:17.051407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dbdc0-7a37-45c5-a670-413ae1655423 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:17.051541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dbdc0-7a37-45c5-a670-413ae1655423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:17.068009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-534dbdc0-7a37-45c5-a670-413ae1655423 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:17.069183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-534dbdc0-7a37-45c5-a670-413ae1655423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:17.128204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:17.136168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 588/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:17.159289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6547-9e9e-4a35-abbc-cc9a98dba01e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:17.238953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:17.257948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6547-9e9e-4a35-abbc-cc9a98dba01e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:17.291682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c2b13-7264-4640-b5cf-a0eed147b0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:17.292328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c2b13-7264-4640-b5cf-a0eed147b0fc None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:17.292608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c2b13-7264-4640-b5cf-a0eed147b0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:17.292887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c2b13-7264-4640-b5cf-a0eed147b0fc None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:17.293679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c2b13-7264-4640-b5cf-a0eed147b0fc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:17.294985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c2b13-7264-4640-b5cf-a0eed147b0fc None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:17.365325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 581/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Thu Jun 2 09:56:17 2022] POST /identity/v3/domains => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:56:19.593732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bc153-e563-4250-9a4d-ccf40b966a3e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:19.594272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bc153-e563-4250-9a4d-ccf40b966a3e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:19.594272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bc153-e563-4250-9a4d-ccf40b966a3e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:19.596254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 589/1170] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:19.601437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cea35c-f336-43a1-8979-d36b1a6ff2ed None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:19.601847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cea35c-f336-43a1-8979-d36b1a6ff2ed None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:19.601985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cea35c-f336-43a1-8979-d36b1a6ff2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:19.618247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b9cea35c-f336-43a1-8979-d36b1a6ff2ed None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:19.619440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b9cea35c-f336-43a1-8979-d36b1a6ff2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:19.683176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 582/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:19.706976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bc153-e563-4250-9a4d-ccf40b966a3e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:19.803197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bc153-e563-4250-9a4d-ccf40b966a3e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:19.836132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120f29f-2da7-44c6-b424-8632ce120ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:19.836960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120f29f-2da7-44c6-b424-8632ce120ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:19.837235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120f29f-2da7-44c6-b424-8632ce120ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:19.837501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120f29f-2da7-44c6-b424-8632ce120ab7 None admin] PATH_INFO: `/v3/domains/a8520a5599524c40bb5d7a2a2c5d69a9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:19.847507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120f29f-2da7-44c6-b424-8632ce120ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a8520a5599524c40bb5d7a2a2c5d69a9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:19.848872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120f29f-2da7-44c6-b424-8632ce120ab7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:19.850447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 590/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Jun 2 09:56:19 2022] GET /identity/v3/domains/a8520a5599524c40bb5d7a2a2c5d69a9 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:19.856252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cea35c-f336-43a1-8979-d36b1a6ff2ed None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:19.922469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:19.951310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cea35c-f336-43a1-8979-d36b1a6ff2ed None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:19.984560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2d50-19f1-4d09-913f-c2cb10309e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:19.985254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2d50-19f1-4d09-913f-c2cb10309e5d None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:19.985577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2d50-19f1-4d09-913f-c2cb10309e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:19.985854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2d50-19f1-4d09-913f-c2cb10309e5d None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:19.986601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2d50-19f1-4d09-913f-c2cb10309e5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:19.988051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2d50-19f1-4d09-913f-c2cb10309e5d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:20.074253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 583/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:56:19 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:56:22.313423 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a638542-a7fb-4fee-abb7-0074cf0dcc2a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:22.313911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a638542-a7fb-4fee-abb7-0074cf0dcc2a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:22.314524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a638542-a7fb-4fee-abb7-0074cf0dcc2a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:22.315876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 591/1174] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:22.321294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe608d-6b0f-44a1-a958-4f0a0b863240 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:22.321730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe608d-6b0f-44a1-a958-4f0a0b863240 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:22.321850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe608d-6b0f-44a1-a958-4f0a0b863240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:22.339076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-71fe608d-6b0f-44a1-a958-4f0a0b863240 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:22.340272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-71fe608d-6b0f-44a1-a958-4f0a0b863240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:22.404039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 584/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:22.429020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a638542-a7fb-4fee-abb7-0074cf0dcc2a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:22.483892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:22.528952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a638542-a7fb-4fee-abb7-0074cf0dcc2a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:22.561166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787d2de-22be-47f7-805b-8ca8bf990f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:22.562014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d2de-22be-47f7-805b-8ca8bf990f6c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:22.562293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d2de-22be-47f7-805b-8ca8bf990f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:22.562564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d2de-22be-47f7-805b-8ca8bf990f6c None admin] PATH_INFO: `/v3/domains/a8520a5599524c40bb5d7a2a2c5d69a9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:22.563751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d2de-22be-47f7-805b-8ca8bf990f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=a8520a5599524c40bb5d7a2a2c5d69a9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:22.565772 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d2de-22be-47f7-805b-8ca8bf990f6c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:22.567380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 592/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Thu Jun 2 09:56:22 2022] GET /identity/v3/domains/a8520a5599524c40bb5d7a2a2c5d69a9 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:22.572928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe608d-6b0f-44a1-a958-4f0a0b863240 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:22.623451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:22.668742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe608d-6b0f-44a1-a958-4f0a0b863240 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:22.702385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea095fc-aac0-418b-90a6-3a389426bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:22.703037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea095fc-aac0-418b-90a6-3a389426bd29 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:22.703345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea095fc-aac0-418b-90a6-3a389426bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:22.703622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea095fc-aac0-418b-90a6-3a389426bd29 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:22.704332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea095fc-aac0-418b-90a6-3a389426bd29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:22.705774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea095fc-aac0-418b-90a6-3a389426bd29 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:22.810334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 585/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:56:22 2022] POST /identity/v3/users => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:56:25.079084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70318d5-5ae0-449d-a1e2-e50527ae9be8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:25.080270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70318d5-5ae0-449d-a1e2-e50527ae9be8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:25.080270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70318d5-5ae0-449d-a1e2-e50527ae9be8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:25.081562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 593/1178] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:25.087073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172fdfa-901a-492a-8bdb-07a48130b905 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:25.087600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172fdfa-901a-492a-8bdb-07a48130b905 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:25.087704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172fdfa-901a-492a-8bdb-07a48130b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:25.104927 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5172fdfa-901a-492a-8bdb-07a48130b905 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:25.106102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5172fdfa-901a-492a-8bdb-07a48130b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:25.171826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 586/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:25.195369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70318d5-5ae0-449d-a1e2-e50527ae9be8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:25.294659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70318d5-5ae0-449d-a1e2-e50527ae9be8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:25.316222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:25.326829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b679d-2013-4f16-9263-9bf3c38a198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:25.330634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b679d-2013-4f16-9263-9bf3c38a198d None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:25.330634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b679d-2013-4f16-9263-9bf3c38a198d None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:25.330634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b679d-2013-4f16-9263-9bf3c38a198d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:25.339173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b679d-2013-4f16-9263-9bf3c38a198d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f90b679d-2013-4f16-9263-9bf3c38a198d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:25.346592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:25.347872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:56:25.349079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 594/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:25.353762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172fdfa-901a-492a-8bdb-07a48130b905 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:25.390986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:25.448709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172fdfa-901a-492a-8bdb-07a48130b905 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:25.480518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295badf9-6989-433a-8c73-aee59b549a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:25.481189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295badf9-6989-433a-8c73-aee59b549a69 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:25.481467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295badf9-6989-433a-8c73-aee59b549a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:25.481734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295badf9-6989-433a-8c73-aee59b549a69 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:25.482462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295badf9-6989-433a-8c73-aee59b549a69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:25.482762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295badf9-6989-433a-8c73-aee59b549a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:25.484132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295badf9-6989-433a-8c73-aee59b549a69 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:25.492359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 587/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:25.497895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b679d-2013-4f16-9263-9bf3c38a198d None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:25.593277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b679d-2013-4f16-9263-9bf3c38a198d None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:25.625275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fcbaf-5db2-47a1-9e20-66bddfe7a106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:25.626132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fcbaf-5db2-47a1-9e20-66bddfe7a106 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:25.626981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fcbaf-5db2-47a1-9e20-66bddfe7a106 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:25.627275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fcbaf-5db2-47a1-9e20-66bddfe7a106 None admin] PATH_INFO: `/v3/users/2ae5cbabb6ea42908d5e1559da52fcfe` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:25.639623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fcbaf-5db2-47a1-9e20-66bddfe7a106 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae5cbabb6ea42908d5e1559da52fcfe)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:25.641045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fcbaf-5db2-47a1-9e20-66bddfe7a106 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:25.642651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 595/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:25 2022] GET /identity/v3/users/2ae5cbabb6ea42908d5e1559da52fcfe => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:25.648487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295badf9-6989-433a-8c73-aee59b549a69 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:25.740722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:25.743529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295badf9-6989-433a-8c73-aee59b549a69 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:25.775124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49334a8-4195-4ef0-98ad-854504ce4164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:25.775754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49334a8-4195-4ef0-98ad-854504ce4164 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:25.776034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49334a8-4195-4ef0-98ad-854504ce4164 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:25.776307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49334a8-4195-4ef0-98ad-854504ce4164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:25.840811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49334a8-4195-4ef0-98ad-854504ce4164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:25.842229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49334a8-4195-4ef0-98ad-854504ce4164 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:25.932712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:25.936153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 588/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:56:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:56:25.941837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fcbaf-5db2-47a1-9e20-66bddfe7a106 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:25.982799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:26.038607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fcbaf-5db2-47a1-9e20-66bddfe7a106 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:26.071226 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f44bdb-0c4f-41b2-9978-f58186d9b652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:26.072066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f44bdb-0c4f-41b2-9978-f58186d9b652 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:26.072369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f44bdb-0c4f-41b2-9978-f58186d9b652 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:26.072640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f44bdb-0c4f-41b2-9978-f58186d9b652 None admin] PATH_INFO: `/v3/projects/fc3520b6f3ee4181bddce38bed5489dd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:26.073789 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f44bdb-0c4f-41b2-9978-f58186d9b652 None admin] RBAC: Authorizing `identity:get_project(project_id=fc3520b6f3ee4181bddce38bed5489dd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:26.075268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f44bdb-0c4f-41b2-9978-f58186d9b652 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:26.076920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 596/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:25 2022] GET /identity/v3/projects/fc3520b6f3ee4181bddce38bed5489dd => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:26.082773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49334a8-4195-4ef0-98ad-854504ce4164 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:26.178772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49334a8-4195-4ef0-98ad-854504ce4164 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:26.211644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ed185-b820-4998-8cea-31c95470c0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:26.212225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ed185-b820-4998-8cea-31c95470c0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:26.212507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ed185-b820-4998-8cea-31c95470c0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:26.212783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ed185-b820-4998-8cea-31c95470c0b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:26.213607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ed185-b820-4998-8cea-31c95470c0b4 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=fc3520b6f3ee4181bddce38bed5489dd, user.id=2ae5cbabb6ea42908d5e1559da52fcfe) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:26.213918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ed185-b820-4998-8cea-31c95470c0b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:26.215343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ed185-b820-4998-8cea-31c95470c0b4 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:26.221178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 589/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:56:26 2022] GET /identity/v3/role_assignments?user.id=2ae5cbabb6ea42908d5e1559da52fcfe&scope.project.id=fc3520b6f3ee4181bddce38bed5489dd&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:28.410399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef16ee3-0016-4aa8-9580-0152964ca1e0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:28.410951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef16ee3-0016-4aa8-9580-0152964ca1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:28.410951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef16ee3-0016-4aa8-9580-0152964ca1e0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:28.412310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 597/1186] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:28.417523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318df22-3acd-43b8-97ca-81c792db08c6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:28.417921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318df22-3acd-43b8-97ca-81c792db08c6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:28.418071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318df22-3acd-43b8-97ca-81c792db08c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:28.434873 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5318df22-3acd-43b8-97ca-81c792db08c6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:28.436098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5318df22-3acd-43b8-97ca-81c792db08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:28.493470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:28.501965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 590/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:28.524300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef16ee3-0016-4aa8-9580-0152964ca1e0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:28.622455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef16ee3-0016-4aa8-9580-0152964ca1e0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:28.631861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:28.654955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c522c-cabd-4e1f-893e-f5814cd0629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:28.655758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c522c-cabd-4e1f-893e-f5814cd0629a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:28.656040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c522c-cabd-4e1f-893e-f5814cd0629a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:28.656313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c522c-cabd-4e1f-893e-f5814cd0629a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:28.666420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c522c-cabd-4e1f-893e-f5814cd0629a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7d2c522c-cabd-4e1f-893e-f5814cd0629a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:28.674537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:28.675671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:56:28.676547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 598/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:28.681529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318df22-3acd-43b8-97ca-81c792db08c6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:28.775509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318df22-3acd-43b8-97ca-81c792db08c6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:28.808133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349780c0-718b-45a9-a334-962d903c5b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:28.808776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349780c0-718b-45a9-a334-962d903c5b84 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:28.809055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349780c0-718b-45a9-a334-962d903c5b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:28.809323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349780c0-718b-45a9-a334-962d903c5b84 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:28.810053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349780c0-718b-45a9-a334-962d903c5b84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:28.810353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349780c0-718b-45a9-a334-962d903c5b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:28.811727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349780c0-718b-45a9-a334-962d903c5b84 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:28.819436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 591/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:28.824981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c522c-cabd-4e1f-893e-f5814cd0629a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:28.920926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c522c-cabd-4e1f-893e-f5814cd0629a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:28.952852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f9b65-d449-417e-a3ef-4e1b785d0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:28.953697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f9b65-d449-417e-a3ef-4e1b785d0ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:28.954000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f9b65-d449-417e-a3ef-4e1b785d0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:28.954272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f9b65-d449-417e-a3ef-4e1b785d0ac2 None admin] PATH_INFO: `/v3/users/2ae5cbabb6ea42908d5e1559da52fcfe` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:28.955458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f9b65-d449-417e-a3ef-4e1b785d0ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae5cbabb6ea42908d5e1559da52fcfe)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:28.956866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f9b65-d449-417e-a3ef-4e1b785d0ac2 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:28.958435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 599/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:28 2022] GET /identity/v3/users/2ae5cbabb6ea42908d5e1559da52fcfe => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:28.964237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349780c0-718b-45a9-a334-962d903c5b84 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:29.020053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:29.061573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349780c0-718b-45a9-a334-962d903c5b84 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:29.093957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbf7c-17f6-403d-9dc3-328db941e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:29.095319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbf7c-17f6-403d-9dc3-328db941e2af None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:29.095601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbf7c-17f6-403d-9dc3-328db941e2af None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:29.095868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbf7c-17f6-403d-9dc3-328db941e2af None admin] PATH_INFO: `/v3/projects/fc3520b6f3ee4181bddce38bed5489dd` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:29.097009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbf7c-17f6-403d-9dc3-328db941e2af None admin] RBAC: Authorizing `identity:get_project(project_id=fc3520b6f3ee4181bddce38bed5489dd)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:29.098409 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbf7c-17f6-403d-9dc3-328db941e2af None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:29.100088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 592/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:28 2022] GET /identity/v3/projects/fc3520b6f3ee4181bddce38bed5489dd => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:29.105765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f9b65-d449-417e-a3ef-4e1b785d0ac2 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:29.139559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:29.201328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f9b65-d449-417e-a3ef-4e1b785d0ac2 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:29.234292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d93689-73b6-4b87-99cc-dff282eb9d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:29.235263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93689-73b6-4b87-99cc-dff282eb9d50 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:29.235573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93689-73b6-4b87-99cc-dff282eb9d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:29.235844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93689-73b6-4b87-99cc-dff282eb9d50 None admin] PATH_INFO: `/v3/projects/fc3520b6f3ee4181bddce38bed5489dd/users/2ae5cbabb6ea42908d5e1559da52fcfe/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:29.237750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d93689-73b6-4b87-99cc-dff282eb9d50 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc3520b6f3ee4181bddce38bed5489dd, user_id=2ae5cbabb6ea42908d5e1559da52fcfe, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:29.239175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d93689-73b6-4b87-99cc-dff282eb9d50 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:29.310225 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 600/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:56:29 2022] PUT /identity/v3/projects/fc3520b6f3ee4181bddce38bed5489dd/users/2ae5cbabb6ea42908d5e1559da52fcfe/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:56:31.483896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810d006-5173-4392-b862-36144ee3f46d None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:31.484429 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810d006-5173-4392-b862-36144ee3f46d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:31.484429 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810d006-5173-4392-b862-36144ee3f46d None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:31.486300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 593/1193] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:31.491531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe5f7-0182-499b-8360-79714445ddd1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:31.491921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe5f7-0182-499b-8360-79714445ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:31.492082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe5f7-0182-499b-8360-79714445ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:31.508898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6e1fe5f7-0182-499b-8360-79714445ddd1 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:31.510065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6e1fe5f7-0182-499b-8360-79714445ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:31.574346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 601/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:31.597689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810d006-5173-4392-b862-36144ee3f46d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:31.696094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810d006-5173-4392-b862-36144ee3f46d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:31.718285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:31.728520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcfeb4-0926-4b4f-92e0-4f6d7821a8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:31.729313 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcfeb4-0926-4b4f-92e0-4f6d7821a8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:31.729595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcfeb4-0926-4b4f-92e0-4f6d7821a8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:31.729866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcfeb4-0926-4b4f-92e0-4f6d7821a8a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:31.740688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcfeb4-0926-4b4f-92e0-4f6d7821a8a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-32bcfeb4-0926-4b4f-92e0-4f6d7821a8a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:31.748162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:31.749278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:56:31.751039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 594/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:31.755742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fe5f7-0182-499b-8360-79714445ddd1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:31.781330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:31.852512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fe5f7-0182-499b-8360-79714445ddd1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:31.885246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef36eb-0b07-47a8-8c5e-44a1d8a20fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:31.885896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef36eb-0b07-47a8-8c5e-44a1d8a20fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:31.886176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef36eb-0b07-47a8-8c5e-44a1d8a20fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:31.886448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef36eb-0b07-47a8-8c5e-44a1d8a20fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:31.887215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef36eb-0b07-47a8-8c5e-44a1d8a20fe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:31.887521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef36eb-0b07-47a8-8c5e-44a1d8a20fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:31.888880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef36eb-0b07-47a8-8c5e-44a1d8a20fe4 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:31.896780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 602/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:31.902374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcfeb4-0926-4b4f-92e0-4f6d7821a8a3 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:31.998224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcfeb4-0926-4b4f-92e0-4f6d7821a8a3 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:32.029943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e50106-d617-494a-9512-40047e056346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:32.030787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e50106-d617-494a-9512-40047e056346 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:32.031064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e50106-d617-494a-9512-40047e056346 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:32.031360 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e50106-d617-494a-9512-40047e056346 None admin] PATH_INFO: `/v3/users/2ae5cbabb6ea42908d5e1559da52fcfe` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:32.033014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e50106-d617-494a-9512-40047e056346 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae5cbabb6ea42908d5e1559da52fcfe)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:32.034415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e50106-d617-494a-9512-40047e056346 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:32.036024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 595/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:31 2022] GET /identity/v3/users/2ae5cbabb6ea42908d5e1559da52fcfe => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:32.041440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef36eb-0b07-47a8-8c5e-44a1d8a20fe4 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:32.126288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:32.137641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef36eb-0b07-47a8-8c5e-44a1d8a20fe4 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:32.170463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdf5c8-8082-4b7e-89e4-8812dbcd8139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:32.171089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdf5c8-8082-4b7e-89e4-8812dbcd8139 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:32.171390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdf5c8-8082-4b7e-89e4-8812dbcd8139 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:32.171666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdf5c8-8082-4b7e-89e4-8812dbcd8139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:32.235889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdf5c8-8082-4b7e-89e4-8812dbcd8139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:32.237310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdf5c8-8082-4b7e-89e4-8812dbcd8139 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:32.318327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:32.330814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 603/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:56:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:56:32.336900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e50106-d617-494a-9512-40047e056346 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:32.386659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:32.431194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e50106-d617-494a-9512-40047e056346 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:32.463433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bca0d-de75-4ea8-aa7f-ff613e776155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:32.464262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bca0d-de75-4ea8-aa7f-ff613e776155 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:32.464537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bca0d-de75-4ea8-aa7f-ff613e776155 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:32.464804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bca0d-de75-4ea8-aa7f-ff613e776155 None admin] PATH_INFO: `/v3/projects/fc3520b6f3ee4181bddce38bed5489dd` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:32.465942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bca0d-de75-4ea8-aa7f-ff613e776155 None admin] RBAC: Authorizing `identity:get_project(project_id=fc3520b6f3ee4181bddce38bed5489dd)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:32.467369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bca0d-de75-4ea8-aa7f-ff613e776155 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:32.468996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 596/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:32 2022] GET /identity/v3/projects/fc3520b6f3ee4181bddce38bed5489dd => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:32.475501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdf5c8-8082-4b7e-89e4-8812dbcd8139 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:32.570316 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdf5c8-8082-4b7e-89e4-8812dbcd8139 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:32.602847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b310bda-5018-4d6e-be9a-3a4921b23d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:32.603501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b310bda-5018-4d6e-be9a-3a4921b23d14 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:32.603780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b310bda-5018-4d6e-be9a-3a4921b23d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:32.604051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b310bda-5018-4d6e-be9a-3a4921b23d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:32.604861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b310bda-5018-4d6e-be9a-3a4921b23d14 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=fc3520b6f3ee4181bddce38bed5489dd, user.id=2ae5cbabb6ea42908d5e1559da52fcfe) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:32.605168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b310bda-5018-4d6e-be9a-3a4921b23d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:32.606559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b310bda-5018-4d6e-be9a-3a4921b23d14 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:32.612148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 604/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:56:32 2022] GET /identity/v3/role_assignments?user.id=2ae5cbabb6ea42908d5e1559da52fcfe&scope.project.id=fc3520b6f3ee4181bddce38bed5489dd&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:42.459191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=40 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:42.609602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=74 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:49.798637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1ce50-df84-4ee0-861a-2d2bae7467c2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:49.799264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1ce50-df84-4ee0-861a-2d2bae7467c2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:49.799264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1ce50-df84-4ee0-861a-2d2bae7467c2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:49.800676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 597/1201] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:57:49.806021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a3fbf-b97b-45f0-8305-e581a2f6272e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:49.811139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a3fbf-b97b-45f0-8305-e581a2f6272e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:49.811139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a3fbf-b97b-45f0-8305-e581a2f6272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:49.824625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-308a3fbf-b97b-45f0-8305-e581a2f6272e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:57:49.826066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-308a3fbf-b97b-45f0-8305-e581a2f6272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:57:49.891834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 605/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:57:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:57:49.916345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1ce50-df84-4ee0-861a-2d2bae7467c2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:50.015770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1ce50-df84-4ee0-861a-2d2bae7467c2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:50.048836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ccbdf-f63d-4a0d-99d1-52a3443389cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:50.049546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccbdf-f63d-4a0d-99d1-52a3443389cf None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:50.049822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccbdf-f63d-4a0d-99d1-52a3443389cf None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:50.050092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccbdf-f63d-4a0d-99d1-52a3443389cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:50.060423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ccbdf-f63d-4a0d-99d1-52a3443389cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:50.061840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ccbdf-f63d-4a0d-99d1-52a3443389cf None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0a8ccbdf-f63d-4a0d-99d1-52a3443389cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:50.078804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:50.079971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:50.080961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:50.080961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:50.080961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:50.080961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:57:50.080961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 598/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:50.086020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a3fbf-b97b-45f0-8305-e581a2f6272e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:50.182689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a3fbf-b97b-45f0-8305-e581a2f6272e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:50.210164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:50.215854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71989304-d46a-4ba1-a1f2-d6f4f5449d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:50.216516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71989304-d46a-4ba1-a1f2-d6f4f5449d04 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:50.216796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71989304-d46a-4ba1-a1f2-d6f4f5449d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:50.217066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71989304-d46a-4ba1-a1f2-d6f4f5449d04 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:50.217778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71989304-d46a-4ba1-a1f2-d6f4f5449d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:50.218082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71989304-d46a-4ba1-a1f2-d6f4f5449d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:50.219466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71989304-d46a-4ba1-a1f2-d6f4f5449d04 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:50.230851 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 606/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:50.236485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ccbdf-f63d-4a0d-99d1-52a3443389cf None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:50.288747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:50.334363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ccbdf-f63d-4a0d-99d1-52a3443389cf None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:50.367260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d148e0-200e-4536-a869-5a182c114676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:50.367926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d148e0-200e-4536-a869-5a182c114676 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:50.368209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d148e0-200e-4536-a869-5a182c114676 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:50.368484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d148e0-200e-4536-a869-5a182c114676 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:50.369852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d148e0-200e-4536-a869-5a182c114676 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:50.371674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d148e0-200e-4536-a869-5a182c114676 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:50.456295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 599/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Thu Jun 2 09:57:50 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:57:52.732069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf808-49ca-4f0a-8272-0f186e48aff6 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:52.732623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf808-49ca-4f0a-8272-0f186e48aff6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:52.732623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf808-49ca-4f0a-8272-0f186e48aff6 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:52.733966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 607/1206] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:57:52.739315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fca8a-188a-43db-bb73-6994c8b27719 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:52.739729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fca8a-188a-43db-bb73-6994c8b27719 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:52.739870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fca8a-188a-43db-bb73-6994c8b27719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:52.756811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e70fca8a-188a-43db-bb73-6994c8b27719 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:57:52.757990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e70fca8a-188a-43db-bb73-6994c8b27719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:57:52.824137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 600/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:57:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:57:52.849164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf808-49ca-4f0a-8272-0f186e48aff6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:52.948075 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf808-49ca-4f0a-8272-0f186e48aff6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:52.981434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acd1b7-0e43-4090-a2aa-08b5e891a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:52.982265 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acd1b7-0e43-4090-a2aa-08b5e891a04e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:52.982491 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acd1b7-0e43-4090-a2aa-08b5e891a04e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:52.982758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acd1b7-0e43-4090-a2aa-08b5e891a04e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:52.993134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acd1b7-0e43-4090-a2aa-08b5e891a04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a1acd1b7-0e43-4090-a2aa-08b5e891a04e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:57:53.000663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:53.003639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:57:53.004722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 608/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:57:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:53.008145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fca8a-188a-43db-bb73-6994c8b27719 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.047658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:53.105131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fca8a-188a-43db-bb73-6994c8b27719 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.137781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22910972-69a4-493d-a7be-8b1fb908b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.138444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22910972-69a4-493d-a7be-8b1fb908b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.138722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22910972-69a4-493d-a7be-8b1fb908b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.138992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22910972-69a4-493d-a7be-8b1fb908b7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.139757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22910972-69a4-493d-a7be-8b1fb908b7f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:53.140061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22910972-69a4-493d-a7be-8b1fb908b7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.141405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22910972-69a4-493d-a7be-8b1fb908b7f8 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.149059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 601/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:53.155844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acd1b7-0e43-4090-a2aa-08b5e891a04e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.204654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:53.251709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acd1b7-0e43-4090-a2aa-08b5e891a04e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.286517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06156af-3b49-48e3-8463-c9a2fdc852b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.287342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06156af-3b49-48e3-8463-c9a2fdc852b5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.287626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06156af-3b49-48e3-8463-c9a2fdc852b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.287901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06156af-3b49-48e3-8463-c9a2fdc852b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.298305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06156af-3b49-48e3-8463-c9a2fdc852b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.304345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06156af-3b49-48e3-8463-c9a2fdc852b5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c06156af-3b49-48e3-8463-c9a2fdc852b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:53.316987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:53.318060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:53.319188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:53.319188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:53.319188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:53.319188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:57:53.319188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 609/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:57:53.324592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22910972-69a4-493d-a7be-8b1fb908b7f8 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.419152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:53.421969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22910972-69a4-493d-a7be-8b1fb908b7f8 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.454910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c678ca3-32af-4ffb-bdbe-838fb80a6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.455587 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c678ca3-32af-4ffb-bdbe-838fb80a6364 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.455868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c678ca3-32af-4ffb-bdbe-838fb80a6364 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.463673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c678ca3-32af-4ffb-bdbe-838fb80a6364 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.463673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c678ca3-32af-4ffb-bdbe-838fb80a6364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:53.463673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c678ca3-32af-4ffb-bdbe-838fb80a6364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.463673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c678ca3-32af-4ffb-bdbe-838fb80a6364 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.469642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 602/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:53.475271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06156af-3b49-48e3-8463-c9a2fdc852b5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.573772 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06156af-3b49-48e3-8463-c9a2fdc852b5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.575692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:53.607637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae397b-0410-4e45-acb5-9615cc68d3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.608472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae397b-0410-4e45-acb5-9615cc68d3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.608757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae397b-0410-4e45-acb5-9615cc68d3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.609028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae397b-0410-4e45-acb5-9615cc68d3e7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.616583 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae397b-0410-4e45-acb5-9615cc68d3e7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.618082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae397b-0410-4e45-acb5-9615cc68d3e7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-c7ae397b-0410-4e45-acb5-9615cc68d3e7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:57:53.632531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:53.633687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:57:53.635344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 610/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:53.640396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c678ca3-32af-4ffb-bdbe-838fb80a6364 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.737506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c678ca3-32af-4ffb-bdbe-838fb80a6364 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.771335 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f644a88-328b-4785-9953-7eb0787e2633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.772017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f644a88-328b-4785-9953-7eb0787e2633 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.772341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f644a88-328b-4785-9953-7eb0787e2633 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.772616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f644a88-328b-4785-9953-7eb0787e2633 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.773438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f644a88-328b-4785-9953-7eb0787e2633 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:53.773740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f644a88-328b-4785-9953-7eb0787e2633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.775205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f644a88-328b-4785-9953-7eb0787e2633 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.793152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 603/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:53.798779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae397b-0410-4e45-acb5-9615cc68d3e7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.899641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae397b-0410-4e45-acb5-9615cc68d3e7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.933694 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738a17-08d0-49fb-8f83-ae01e0f49724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.934324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738a17-08d0-49fb-8f83-ae01e0f49724 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.934603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738a17-08d0-49fb-8f83-ae01e0f49724 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.934880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed738a17-08d0-49fb-8f83-ae01e0f49724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.964176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:54.001662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738a17-08d0-49fb-8f83-ae01e0f49724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:54.003146 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed738a17-08d0-49fb-8f83-ae01e0f49724 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:54.099503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 611/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:57:54.105750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f644a88-328b-4785-9953-7eb0787e2633 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:54.125317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:54.204729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f644a88-328b-4785-9953-7eb0787e2633 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:54.238624 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18ae3c-a5e8-460f-8fc2-44ff717145d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:54.239570 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18ae3c-a5e8-460f-8fc2-44ff717145d9 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:54.239851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18ae3c-a5e8-460f-8fc2-44ff717145d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:54.240125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18ae3c-a5e8-460f-8fc2-44ff717145d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:54.250456 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18ae3c-a5e8-460f-8fc2-44ff717145d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:54.252063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18ae3c-a5e8-460f-8fc2-44ff717145d9 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-0e18ae3c-a5e8-460f-8fc2-44ff717145d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:54.270217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:54.271269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:54.272366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:54.272366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:54.272366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:54.272366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:57:54.272366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 604/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:54.277191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738a17-08d0-49fb-8f83-ae01e0f49724 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:54.337308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:54.374032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed738a17-08d0-49fb-8f83-ae01e0f49724 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:54.407001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead91ba-4f27-4ec1-bdec-182c148de6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:54.407680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead91ba-4f27-4ec1-bdec-182c148de6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:54.407961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead91ba-4f27-4ec1-bdec-182c148de6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:54.408234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead91ba-4f27-4ec1-bdec-182c148de6e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:54.408949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead91ba-4f27-4ec1-bdec-182c148de6e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:54.409258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead91ba-4f27-4ec1-bdec-182c148de6e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:54.410605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead91ba-4f27-4ec1-bdec-182c148de6e6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:54.421995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 612/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:54.427841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18ae3c-a5e8-460f-8fc2-44ff717145d9 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:54.496973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:54.526220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18ae3c-a5e8-460f-8fc2-44ff717145d9 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:54.559038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59718cc-20b0-410d-a8c2-8250c2a39c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:54.559838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59718cc-20b0-410d-a8c2-8250c2a39c86 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:54.560116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59718cc-20b0-410d-a8c2-8250c2a39c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:54.560383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59718cc-20b0-410d-a8c2-8250c2a39c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:54.567658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59718cc-20b0-410d-a8c2-8250c2a39c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:54.569061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59718cc-20b0-410d-a8c2-8250c2a39c86 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d59718cc-20b0-410d-a8c2-8250c2a39c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:57:54.582559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:54.588989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:54.590140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:57:54.590140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:57:54.590140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:57:54.590140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:57:54.590140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:57:54.590140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:57:54.590140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:54.590140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:57:54.590140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 605/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:54.590778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead91ba-4f27-4ec1-bdec-182c148de6e6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:54.689605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead91ba-4f27-4ec1-bdec-182c148de6e6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:54.711454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:54.722675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd7848-1b9f-42d2-a5f8-4fe4b1e31206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:54.723409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd7848-1b9f-42d2-a5f8-4fe4b1e31206 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:54.723689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd7848-1b9f-42d2-a5f8-4fe4b1e31206 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:54.723983 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd7848-1b9f-42d2-a5f8-4fe4b1e31206 None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:54.724768 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd7848-1b9f-42d2-a5f8-4fe4b1e31206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:54.725098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd7848-1b9f-42d2-a5f8-4fe4b1e31206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:54.726506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd7848-1b9f-42d2-a5f8-4fe4b1e31206 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:54.738646 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 613/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:54.745266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59718cc-20b0-410d-a8c2-8250c2a39c86 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:54.844116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59718cc-20b0-410d-a8c2-8250c2a39c86 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:54.872613 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:54.878281 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006130a-f661-4717-9c21-78805454fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:54.878937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006130a-f661-4717-9c21-78805454fc27 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:54.879266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006130a-f661-4717-9c21-78805454fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:54.879545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006130a-f661-4717-9c21-78805454fc27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:54.880507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006130a-f661-4717-9c21-78805454fc27 None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=bef7eacc5dc0445fa3297db10c8b4d4c) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:54.880821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006130a-f661-4717-9c21-78805454fc27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:54.882234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006130a-f661-4717-9c21-78805454fc27 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:54.887660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 606/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:57:54 2022] GET /identity/v3/role_assignments?user.id=bef7eacc5dc0445fa3297db10c8b4d4c&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:57.090305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261188fe-599b-436a-80c3-1f9713d9ea19 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.090889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261188fe-599b-436a-80c3-1f9713d9ea19 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.090889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261188fe-599b-436a-80c3-1f9713d9ea19 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.092275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 614/1220] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:57:57.097560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05e520-6cbc-4d66-819d-3c9dd05bf40c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.097998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05e520-6cbc-4d66-819d-3c9dd05bf40c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.098106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05e520-6cbc-4d66-819d-3c9dd05bf40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.114816 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2a05e520-6cbc-4d66-819d-3c9dd05bf40c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:57:57.116055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2a05e520-6cbc-4d66-819d-3c9dd05bf40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:57:57.180185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 607/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:57:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:57:57.204097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261188fe-599b-436a-80c3-1f9713d9ea19 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.304915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261188fe-599b-436a-80c3-1f9713d9ea19 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.339416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45bac-7328-48a5-a3d0-2986b25cfd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.340210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45bac-7328-48a5-a3d0-2986b25cfd52 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.340543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45bac-7328-48a5-a3d0-2986b25cfd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.340766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45bac-7328-48a5-a3d0-2986b25cfd52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.351163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45bac-7328-48a5-a3d0-2986b25cfd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-bcf45bac-7328-48a5-a3d0-2986b25cfd52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:57:57.359184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:57.360283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:57:57.361243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 615/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:57.365936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05e520-6cbc-4d66-819d-3c9dd05bf40c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.463244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05e520-6cbc-4d66-819d-3c9dd05bf40c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.485715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:57.496326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80300bbe-afb6-4919-8b18-110e5ee30521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.497041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80300bbe-afb6-4919-8b18-110e5ee30521 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.497327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80300bbe-afb6-4919-8b18-110e5ee30521 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.497601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80300bbe-afb6-4919-8b18-110e5ee30521 None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.498333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80300bbe-afb6-4919-8b18-110e5ee30521 None admin] RBAC: Adding query filter params (name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:57.498635 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80300bbe-afb6-4919-8b18-110e5ee30521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:57.500022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80300bbe-afb6-4919-8b18-110e5ee30521 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:57.507720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 608/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:57.514303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45bac-7328-48a5-a3d0-2986b25cfd52 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.558739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:57.614473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45bac-7328-48a5-a3d0-2986b25cfd52 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.648253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de702fd2-6b4d-47e2-80b7-aef43eba4303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.649038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de702fd2-6b4d-47e2-80b7-aef43eba4303 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.649313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de702fd2-6b4d-47e2-80b7-aef43eba4303 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.649756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de702fd2-6b4d-47e2-80b7-aef43eba4303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.660187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de702fd2-6b4d-47e2-80b7-aef43eba4303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:57.661625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de702fd2-6b4d-47e2-80b7-aef43eba4303 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-de702fd2-6b4d-47e2-80b7-aef43eba4303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:57.678638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:57.679715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:57.680644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:57.680644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:57.680644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:57.680644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:57:57.680644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 616/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:57.686158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80300bbe-afb6-4919-8b18-110e5ee30521 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.783686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80300bbe-afb6-4919-8b18-110e5ee30521 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.816948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971dbb-a367-4b74-b3a9-e0d3fe4efdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.817600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971dbb-a367-4b74-b3a9-e0d3fe4efdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.817879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971dbb-a367-4b74-b3a9-e0d3fe4efdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.818153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971dbb-a367-4b74-b3a9-e0d3fe4efdf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.818860 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971dbb-a367-4b74-b3a9-e0d3fe4efdf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:57.819190 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971dbb-a367-4b74-b3a9-e0d3fe4efdf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:57.820569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971dbb-a367-4b74-b3a9-e0d3fe4efdf5 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:57.832343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 609/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:57.838349 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de702fd2-6b4d-47e2-80b7-aef43eba4303 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.930169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:57.937179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de702fd2-6b4d-47e2-80b7-aef43eba4303 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.969830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bbf53-8e97-4142-ad43-93e5a6dbc448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.970624 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bbf53-8e97-4142-ad43-93e5a6dbc448 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.970905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bbf53-8e97-4142-ad43-93e5a6dbc448 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.971208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bbf53-8e97-4142-ad43-93e5a6dbc448 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.979078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bbf53-8e97-4142-ad43-93e5a6dbc448 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:57.980539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bbf53-8e97-4142-ad43-93e5a6dbc448 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-a97bbf53-8e97-4142-ad43-93e5a6dbc448 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:57:57.994803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:57.995924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:57:57.997107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 617/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:58.001892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971dbb-a367-4b74-b3a9-e0d3fe4efdf5 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:58.048464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:58.098739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971dbb-a367-4b74-b3a9-e0d3fe4efdf5 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:58.131230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804f441-64e0-45a6-a6b9-8b7a48a64b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:58.131892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f441-64e0-45a6-a6b9-8b7a48a64b05 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:58.132174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f441-64e0-45a6-a6b9-8b7a48a64b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:58.132449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f441-64e0-45a6-a6b9-8b7a48a64b05 None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:58.133279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804f441-64e0-45a6-a6b9-8b7a48a64b05 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:58.133589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804f441-64e0-45a6-a6b9-8b7a48a64b05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:58.135040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804f441-64e0-45a6-a6b9-8b7a48a64b05 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:58.152205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 610/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 2 09:57:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:58.158029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bbf53-8e97-4142-ad43-93e5a6dbc448 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:58.255358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bbf53-8e97-4142-ad43-93e5a6dbc448 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:58.288086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ab529-a278-481a-8fbf-ad6b06e1d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:58.288862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ab529-a278-481a-8fbf-ad6b06e1d4ab None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:58.289139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ab529-a278-481a-8fbf-ad6b06e1d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:58.289409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ab529-a278-481a-8fbf-ad6b06e1d4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:58.300232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ab529-a278-481a-8fbf-ad6b06e1d4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:58.301642 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ab529-a278-481a-8fbf-ad6b06e1d4ab None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-f06ab529-a278-481a-8fbf-ad6b06e1d4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:58.318037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:58.319030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:58.320024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:58.320024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:58.320024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:58.320024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:57:58.320024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 618/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:58.325712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804f441-64e0-45a6-a6b9-8b7a48a64b05 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:58.419862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804f441-64e0-45a6-a6b9-8b7a48a64b05 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:58.422091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:58.452177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dabd6-0431-4f13-a91f-747647b4c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:58.452818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dabd6-0431-4f13-a91f-747647b4c529 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:58.453095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dabd6-0431-4f13-a91f-747647b4c529 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:58.453364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dabd6-0431-4f13-a91f-747647b4c529 None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:58.454064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dabd6-0431-4f13-a91f-747647b4c529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:58.454365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dabd6-0431-4f13-a91f-747647b4c529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:58.455748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dabd6-0431-4f13-a91f-747647b4c529 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:58.466932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 611/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:58.472576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ab529-a278-481a-8fbf-ad6b06e1d4ab None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:58.481879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:58.572371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ab529-a278-481a-8fbf-ad6b06e1d4ab None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:58.605518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa454e-acc1-4335-a6f7-07d94870699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:58.606300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa454e-acc1-4335-a6f7-07d94870699a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:58.606579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa454e-acc1-4335-a6f7-07d94870699a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:58.606848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa454e-acc1-4335-a6f7-07d94870699a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:58.613522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa454e-acc1-4335-a6f7-07d94870699a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:58.614995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa454e-acc1-4335-a6f7-07d94870699a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-9bfa454e-acc1-4335-a6f7-07d94870699a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:57:58.629270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:58.630339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:58.638876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:57:58.638876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:57:58.638876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:57:58.638876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:57:58.638876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:57:58.638876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:57:58.638876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:58.638876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:57:58.638876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 619/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:58.639517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dabd6-0431-4f13-a91f-747647b4c529 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:58.735327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dabd6-0431-4f13-a91f-747647b4c529 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:58.768425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1d83e-9140-4c61-b509-390eeedd11c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:58.769076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d83e-9140-4c61-b509-390eeedd11c7 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:58.769357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d83e-9140-4c61-b509-390eeedd11c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:58.769638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d83e-9140-4c61-b509-390eeedd11c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:58.770413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1d83e-9140-4c61-b509-390eeedd11c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:58.770722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1d83e-9140-4c61-b509-390eeedd11c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:58.772226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1d83e-9140-4c61-b509-390eeedd11c7 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:58.784655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 612/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:58.790640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa454e-acc1-4335-a6f7-07d94870699a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:58.855266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:58.888670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa454e-acc1-4335-a6f7-07d94870699a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:58.923001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa8914-f66d-4e77-971c-3d56e846a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:58.923895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa8914-f66d-4e77-971c-3d56e846a600 None admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:58.924165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa8914-f66d-4e77-971c-3d56e846a600 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:58.924427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa8914-f66d-4e77-971c-3d56e846a600 None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/bef7eacc5dc0445fa3297db10c8b4d4c/roles/e8972a7e9ed3405c9912b4d0a12fa6f6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:58.939565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa8914-f66d-4e77-971c-3d56e846a600 None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=bef7eacc5dc0445fa3297db10c8b4d4c, role_id=e8972a7e9ed3405c9912b4d0a12fa6f6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:58.941026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa8914-f66d-4e77-971c-3d56e846a600 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:59.080550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 620/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:57:58 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/bef7eacc5dc0445fa3297db10c8b4d4c/roles/e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:58:01.270678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f317bae-54c7-4420-901a-59e7b2c0153f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.271167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f317bae-54c7-4420-901a-59e7b2c0153f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.271303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f317bae-54c7-4420-901a-59e7b2c0153f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.272684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 613/1233] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:01.278411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469295cc-d7a7-4c56-bcc4-13d6c9eddf94 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.278849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469295cc-d7a7-4c56-bcc4-13d6c9eddf94 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.278952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469295cc-d7a7-4c56-bcc4-13d6c9eddf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.295686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-469295cc-d7a7-4c56-bcc4-13d6c9eddf94 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:01.296891 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-469295cc-d7a7-4c56-bcc4-13d6c9eddf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:01.362877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 621/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:01.386960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f317bae-54c7-4420-901a-59e7b2c0153f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.412311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:01.485954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f317bae-54c7-4420-901a-59e7b2c0153f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.518474 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ef2e-25f3-498a-add0-8a9b9b819400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:01.519221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ef2e-25f3-498a-add0-8a9b9b819400 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.519499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ef2e-25f3-498a-add0-8a9b9b819400 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.519768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ef2e-25f3-498a-add0-8a9b9b819400 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.530126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ef2e-25f3-498a-add0-8a9b9b819400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-d945ef2e-25f3-498a-add0-8a9b9b819400 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:58:01.537885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:01.538936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:01.539815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 614/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:01.545340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469295cc-d7a7-4c56-bcc4-13d6c9eddf94 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.592115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:01.642813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469295cc-d7a7-4c56-bcc4-13d6c9eddf94 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.675794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa75f1b-351b-42ae-9ae8-9a0f6ca8ad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:01.676455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa75f1b-351b-42ae-9ae8-9a0f6ca8ad5c None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.676738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa75f1b-351b-42ae-9ae8-9a0f6ca8ad5c None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.677014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa75f1b-351b-42ae-9ae8-9a0f6ca8ad5c None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.677750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa75f1b-351b-42ae-9ae8-9a0f6ca8ad5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:01.678055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa75f1b-351b-42ae-9ae8-9a0f6ca8ad5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:01.679445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa75f1b-351b-42ae-9ae8-9a0f6ca8ad5c None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:01.688670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 622/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:01.694437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ef2e-25f3-498a-add0-8a9b9b819400 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.779375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:01.800079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ef2e-25f3-498a-add0-8a9b9b819400 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.836704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df047e8f-efc8-4130-86c2-d36bea8d5339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:01.837491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df047e8f-efc8-4130-86c2-d36bea8d5339 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.837773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df047e8f-efc8-4130-86c2-d36bea8d5339 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.838046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df047e8f-efc8-4130-86c2-d36bea8d5339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.848344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df047e8f-efc8-4130-86c2-d36bea8d5339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:01.849779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df047e8f-efc8-4130-86c2-d36bea8d5339 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-df047e8f-efc8-4130-86c2-d36bea8d5339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:01.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:01.867334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:01.869156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:01.869156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:01.869156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:01.869156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:01.869156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 615/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:01.873883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa75f1b-351b-42ae-9ae8-9a0f6ca8ad5c None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.971737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa75f1b-351b-42ae-9ae8-9a0f6ca8ad5c None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.981019 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:02.005419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fd774-68fa-45eb-90b2-87fbc048d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:02.006072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fd774-68fa-45eb-90b2-87fbc048d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:02.006432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fd774-68fa-45eb-90b2-87fbc048d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:02.006705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fd774-68fa-45eb-90b2-87fbc048d3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:02.007452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fd774-68fa-45eb-90b2-87fbc048d3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:02.007756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fd774-68fa-45eb-90b2-87fbc048d3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:02.009733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fd774-68fa-45eb-90b2-87fbc048d3b6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:02.020523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 623/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:02.026247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df047e8f-efc8-4130-86c2-d36bea8d5339 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:02.123705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df047e8f-efc8-4130-86c2-d36bea8d5339 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:02.158275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0afd6-39e5-4d39-ad22-cdd214381aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:02.159069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0afd6-39e5-4d39-ad22-cdd214381aad None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:02.159452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0afd6-39e5-4d39-ad22-cdd214381aad None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:02.159729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0afd6-39e5-4d39-ad22-cdd214381aad None admin] PATH_INFO: `/v3/users/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:02.163222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:02.168884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0afd6-39e5-4d39-ad22-cdd214381aad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:02.170438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0afd6-39e5-4d39-ad22-cdd214381aad None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-3cb0afd6-39e5-4d39-ad22-cdd214381aad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:58:02.185189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:02.186331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:02.187532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 616/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:02.192209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fd774-68fa-45eb-90b2-87fbc048d3b6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:02.293854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fd774-68fa-45eb-90b2-87fbc048d3b6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:02.327862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953aab1-b1d0-4530-a7e4-8188c631fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:02.328530 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953aab1-b1d0-4530-a7e4-8188c631fee1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:02.328810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953aab1-b1d0-4530-a7e4-8188c631fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:02.329084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953aab1-b1d0-4530-a7e4-8188c631fee1 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:02.329971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953aab1-b1d0-4530-a7e4-8188c631fee1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:02.330284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953aab1-b1d0-4530-a7e4-8188c631fee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:02.331738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953aab1-b1d0-4530-a7e4-8188c631fee1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:02.348866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 624/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 2 09:58:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:02.355209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0afd6-39e5-4d39-ad22-cdd214381aad None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:02.451627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0afd6-39e5-4d39-ad22-cdd214381aad None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:02.484598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00033d85-9772-45d7-b599-b1bae7cfee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:02.485239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00033d85-9772-45d7-b599-b1bae7cfee71 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:02.485516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00033d85-9772-45d7-b599-b1bae7cfee71 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:02.485787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00033d85-9772-45d7-b599-b1bae7cfee71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:02.544654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:02.550819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00033d85-9772-45d7-b599-b1bae7cfee71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:02.552293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00033d85-9772-45d7-b599-b1bae7cfee71 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:02.647688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 617/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:58:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:58:02.654106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953aab1-b1d0-4530-a7e4-8188c631fee1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:02.681583 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:02.753836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953aab1-b1d0-4530-a7e4-8188c631fee1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:02.788284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091d51-4a97-44ee-bd9c-14f0c45f428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:02.789068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091d51-4a97-44ee-bd9c-14f0c45f428a None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:02.789347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091d51-4a97-44ee-bd9c-14f0c45f428a None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:02.790227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091d51-4a97-44ee-bd9c-14f0c45f428a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:02.799980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c091d51-4a97-44ee-bd9c-14f0c45f428a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:02.801617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c091d51-4a97-44ee-bd9c-14f0c45f428a None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-1c091d51-4a97-44ee-bd9c-14f0c45f428a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:02.822758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:02.823715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:02.824988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:02.824988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:02.824988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:02.824988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:02.824988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 625/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:02.829975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00033d85-9772-45d7-b599-b1bae7cfee71 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:02.920379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:02.925874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00033d85-9772-45d7-b599-b1bae7cfee71 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:02.958264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054474e9-c2cb-40d7-b4bb-43027133e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:02.958913 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054474e9-c2cb-40d7-b4bb-43027133e01e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:02.959221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054474e9-c2cb-40d7-b4bb-43027133e01e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:02.959495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054474e9-c2cb-40d7-b4bb-43027133e01e None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:02.960208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054474e9-c2cb-40d7-b4bb-43027133e01e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:02.960511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054474e9-c2cb-40d7-b4bb-43027133e01e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:02.962468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054474e9-c2cb-40d7-b4bb-43027133e01e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:02.973272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 618/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:02.978907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091d51-4a97-44ee-bd9c-14f0c45f428a None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:03.057257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:03.078910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091d51-4a97-44ee-bd9c-14f0c45f428a None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:03.112612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34de6d-1530-4924-bfba-5a968e453c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:03.113468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34de6d-1530-4924-bfba-5a968e453c83 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:03.113746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34de6d-1530-4924-bfba-5a968e453c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:03.114020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34de6d-1530-4924-bfba-5a968e453c83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:03.120727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34de6d-1530-4924-bfba-5a968e453c83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:03.122227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34de6d-1530-4924-bfba-5a968e453c83 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-3f34de6d-1530-4924-bfba-5a968e453c83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:58:03.137467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:03.138566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:03.139639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:58:03.139639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:58:03.139639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:58:03.139639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:58:03.139639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:58:03.139639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:58:03.139639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:03.139639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:03.139639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 626/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:03.144438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054474e9-c2cb-40d7-b4bb-43027133e01e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:03.243251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054474e9-c2cb-40d7-b4bb-43027133e01e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:03.277082 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f0d4d-1edd-477e-9417-ae243030d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:03.277739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f0d4d-1edd-477e-9417-ae243030d358 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:03.281445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f0d4d-1edd-477e-9417-ae243030d358 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:03.281445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f0d4d-1edd-477e-9417-ae243030d358 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:03.281445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f0d4d-1edd-477e-9417-ae243030d358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:03.281445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f0d4d-1edd-477e-9417-ae243030d358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:03.281445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f0d4d-1edd-477e-9417-ae243030d358 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:03.292676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 619/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:03.298617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34de6d-1530-4924-bfba-5a968e453c83 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:03.398463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34de6d-1530-4924-bfba-5a968e453c83 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:03.430970 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e9b50-517b-478a-84fb-e3b2aa6ef32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:03.431636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9b50-517b-478a-84fb-e3b2aa6ef32f None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:03.431912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9b50-517b-478a-84fb-e3b2aa6ef32f None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:03.432178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9b50-517b-478a-84fb-e3b2aa6ef32f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:03.432997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e9b50-517b-478a-84fb-e3b2aa6ef32f None admin] RBAC: Adding query filter params (role.id=e8972a7e9ed3405c9912b4d0a12fa6f6, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=bef7eacc5dc0445fa3297db10c8b4d4c) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:03.433305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e9b50-517b-478a-84fb-e3b2aa6ef32f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:03.434713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e9b50-517b-478a-84fb-e3b2aa6ef32f None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:03.440511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 627/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:58:03 2022] GET /identity/v3/role_assignments?user.id=bef7eacc5dc0445fa3297db10c8b4d4c&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=e8972a7e9ed3405c9912b4d0a12fa6f6 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:05.691439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27948-db64-4375-aab3-21993ea5e2eb None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:05.691973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27948-db64-4375-aab3-21993ea5e2eb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:05.691973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27948-db64-4375-aab3-21993ea5e2eb None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:05.693327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 620/1247] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:05.698742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac7cfb-4174-478b-a723-e0a149a4643b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:05.699445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac7cfb-4174-478b-a723-e0a149a4643b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:05.699651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac7cfb-4174-478b-a723-e0a149a4643b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:05.704806 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:05.717251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7cac7cfb-4174-478b-a723-e0a149a4643b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:05.718434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7cac7cfb-4174-478b-a723-e0a149a4643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:05.784466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 628/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:05.808225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c27948-db64-4375-aab3-21993ea5e2eb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:05.827271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:05.908695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c27948-db64-4375-aab3-21993ea5e2eb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:05.943521 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6036b-6d94-4a4a-aa77-491694077f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:05.944269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6036b-6d94-4a4a-aa77-491694077f5c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:05.944550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6036b-6d94-4a4a-aa77-491694077f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:05.944820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6036b-6d94-4a4a-aa77-491694077f5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:05.955556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6036b-6d94-4a4a-aa77-491694077f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-bcf6036b-6d94-4a4a-aa77-491694077f5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:58:05.963818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:05.964777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:05.965645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 621/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:05.971166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac7cfb-4174-478b-a723-e0a149a4643b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.068268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac7cfb-4174-478b-a723-e0a149a4643b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.097794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:06.102725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049302c3-b91c-4f2d-a9c1-9bfe74e1fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.103231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049302c3-b91c-4f2d-a9c1-9bfe74e1fa69 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.103516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049302c3-b91c-4f2d-a9c1-9bfe74e1fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.103793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049302c3-b91c-4f2d-a9c1-9bfe74e1fa69 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.104531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049302c3-b91c-4f2d-a9c1-9bfe74e1fa69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:06.104839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049302c3-b91c-4f2d-a9c1-9bfe74e1fa69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.106194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049302c3-b91c-4f2d-a9c1-9bfe74e1fa69 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.114146 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 629/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:58:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:06.119856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6036b-6d94-4a4a-aa77-491694077f5c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.195669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:06.217756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6036b-6d94-4a4a-aa77-491694077f5c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.251875 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119beaf5-6603-4bbe-8f8e-49eaf3c86706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.252659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119beaf5-6603-4bbe-8f8e-49eaf3c86706 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.252941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119beaf5-6603-4bbe-8f8e-49eaf3c86706 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.253211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119beaf5-6603-4bbe-8f8e-49eaf3c86706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.264257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119beaf5-6603-4bbe-8f8e-49eaf3c86706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.265708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119beaf5-6603-4bbe-8f8e-49eaf3c86706 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-119beaf5-6603-4bbe-8f8e-49eaf3c86706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:06.282469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:06.283578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:06.284756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:06.284756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:06.284756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:06.284756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:06.284756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 622/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:06.289394 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049302c3-b91c-4f2d-a9c1-9bfe74e1fa69 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.389275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049302c3-b91c-4f2d-a9c1-9bfe74e1fa69 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.421736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78618069-9d84-4baf-aa68-c631b9479760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.422406 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618069-9d84-4baf-aa68-c631b9479760 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.422672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618069-9d84-4baf-aa68-c631b9479760 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.422941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618069-9d84-4baf-aa68-c631b9479760 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.423692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78618069-9d84-4baf-aa68-c631b9479760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:06.428380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78618069-9d84-4baf-aa68-c631b9479760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.428380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78618069-9d84-4baf-aa68-c631b9479760 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.438356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 630/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:06.444087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119beaf5-6603-4bbe-8f8e-49eaf3c86706 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.543864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119beaf5-6603-4bbe-8f8e-49eaf3c86706 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.569167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:06.576899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f49214-dd4e-4d34-98db-c1ad730e2b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.577688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f49214-dd4e-4d34-98db-c1ad730e2b80 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.577965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f49214-dd4e-4d34-98db-c1ad730e2b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.578284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f49214-dd4e-4d34-98db-c1ad730e2b80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.585498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f49214-dd4e-4d34-98db-c1ad730e2b80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.586931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f49214-dd4e-4d34-98db-c1ad730e2b80 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-46f49214-dd4e-4d34-98db-c1ad730e2b80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:58:06.600906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:06.602478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:06.603666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 623/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:06.608409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78618069-9d84-4baf-aa68-c631b9479760 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.662614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:06.706412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78618069-9d84-4baf-aa68-c631b9479760 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.740371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8397d-e667-41ed-9579-7190b0d673a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.763706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8397d-e667-41ed-9579-7190b0d673a6 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.763706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8397d-e667-41ed-9579-7190b0d673a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.763706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8397d-e667-41ed-9579-7190b0d673a6 None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.763706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8397d-e667-41ed-9579-7190b0d673a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:06.763706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8397d-e667-41ed-9579-7190b0d673a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.763706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8397d-e667-41ed-9579-7190b0d673a6 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.764210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 631/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:06.766645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f49214-dd4e-4d34-98db-c1ad730e2b80 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.863645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f49214-dd4e-4d34-98db-c1ad730e2b80 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.896127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84255208-5312-4b4a-8930-69e873a0db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.896760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255208-5312-4b4a-8930-69e873a0db0c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.897045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255208-5312-4b4a-8930-69e873a0db0c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.897322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255208-5312-4b4a-8930-69e873a0db0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.952320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:06.964950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84255208-5312-4b4a-8930-69e873a0db0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.966401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84255208-5312-4b4a-8930-69e873a0db0c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:07.063343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 624/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:58:07.069142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8397d-e667-41ed-9579-7190b0d673a6 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:07.169833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8397d-e667-41ed-9579-7190b0d673a6 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:07.182554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:07.203017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89ab11-ade7-4097-bb7c-ee6a00f988da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:07.203904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89ab11-ade7-4097-bb7c-ee6a00f988da None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:07.204183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89ab11-ade7-4097-bb7c-ee6a00f988da None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:07.204495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89ab11-ade7-4097-bb7c-ee6a00f988da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:07.214691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89ab11-ade7-4097-bb7c-ee6a00f988da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:07.216217 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89ab11-ade7-4097-bb7c-ee6a00f988da None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7e89ab11-ade7-4097-bb7c-ee6a00f988da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:07.233797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:07.234846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:07.235949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:07.235949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:07.235949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:07.235949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:07.235949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 632/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:07.240639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84255208-5312-4b4a-8930-69e873a0db0c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:07.328100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:07.340735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84255208-5312-4b4a-8930-69e873a0db0c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:07.372675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d9dcc-65b4-4ed0-9d05-964c04a3233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:07.373326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d9dcc-65b4-4ed0-9d05-964c04a3233d None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:07.373607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d9dcc-65b4-4ed0-9d05-964c04a3233d None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:07.373880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d9dcc-65b4-4ed0-9d05-964c04a3233d None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:07.374584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d9dcc-65b4-4ed0-9d05-964c04a3233d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:07.374887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d9dcc-65b4-4ed0-9d05-964c04a3233d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:07.376316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d9dcc-65b4-4ed0-9d05-964c04a3233d None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:07.387596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 625/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:07.393211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89ab11-ade7-4097-bb7c-ee6a00f988da None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:07.494184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89ab11-ade7-4097-bb7c-ee6a00f988da None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:07.528458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c24c7-6178-475d-992c-f3c61040f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:07.529280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c24c7-6178-475d-992c-f3c61040f7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:07.529562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c24c7-6178-475d-992c-f3c61040f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:07.529842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c24c7-6178-475d-992c-f3c61040f7e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:07.536557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c24c7-6178-475d-992c-f3c61040f7e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:07.537984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c24c7-6178-475d-992c-f3c61040f7e7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-7e0c24c7-6178-475d-992c-f3c61040f7e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:58:07.551516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:07.552591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:07.553607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:58:07.553607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:58:07.553607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:58:07.553607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:58:07.553607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:58:07.553607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:58:07.553607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:07.553607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:07.553607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 633/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:07.558475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d9dcc-65b4-4ed0-9d05-964c04a3233d None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:07.657114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d9dcc-65b4-4ed0-9d05-964c04a3233d None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:07.689692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572a8b8-e0ac-412c-9927-8617f8b21083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:07.690347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572a8b8-e0ac-412c-9927-8617f8b21083 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:07.690630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572a8b8-e0ac-412c-9927-8617f8b21083 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:07.690902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572a8b8-e0ac-412c-9927-8617f8b21083 None admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:07.691731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572a8b8-e0ac-412c-9927-8617f8b21083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:07.692038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572a8b8-e0ac-412c-9927-8617f8b21083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:07.693472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572a8b8-e0ac-412c-9927-8617f8b21083 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:07.706867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 626/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:07.713014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c24c7-6178-475d-992c-f3c61040f7e7 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:07.739422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:07.815065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c24c7-6178-475d-992c-f3c61040f7e7 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:07.849220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c38a4-7f7d-4cb1-ae2b-6bfa09b23232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:07.849864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c38a4-7f7d-4cb1-ae2b-6bfa09b23232 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:07.850147 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c38a4-7f7d-4cb1-ae2b-6bfa09b23232 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:07.850422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c38a4-7f7d-4cb1-ae2b-6bfa09b23232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:07.851284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c38a4-7f7d-4cb1-ae2b-6bfa09b23232 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=bef7eacc5dc0445fa3297db10c8b4d4c) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:07.851655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c38a4-7f7d-4cb1-ae2b-6bfa09b23232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:07.853226 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c38a4-7f7d-4cb1-ae2b-6bfa09b23232 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:07.858623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 634/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:58:07 2022] GET /identity/v3/role_assignments?user.id=bef7eacc5dc0445fa3297db10c8b4d4c&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:10.071319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9255f5-5745-4130-af6c-9455c7b3ab98 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:10.071911 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9255f5-5745-4130-af6c-9455c7b3ab98 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:10.071911 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9255f5-5745-4130-af6c-9455c7b3ab98 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:10.073219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 627/1261] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:10.078642 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81106b1c-30dc-4f6d-ab3f-66906cad34c6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:10.079039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81106b1c-30dc-4f6d-ab3f-66906cad34c6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:10.079234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81106b1c-30dc-4f6d-ab3f-66906cad34c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:10.096333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-81106b1c-30dc-4f6d-ab3f-66906cad34c6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:10.097507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-81106b1c-30dc-4f6d-ab3f-66906cad34c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:10.163512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 635/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:10.186962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9255f5-5745-4130-af6c-9455c7b3ab98 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:10.197840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:10.286645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9255f5-5745-4130-af6c-9455c7b3ab98 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:10.319574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920ceec-c14a-4374-9be5-9051814c108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:10.320865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920ceec-c14a-4374-9be5-9051814c108e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:10.321143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920ceec-c14a-4374-9be5-9051814c108e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:10.321459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920ceec-c14a-4374-9be5-9051814c108e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:10.331444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920ceec-c14a-4374-9be5-9051814c108e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-1920ceec-c14a-4374-9be5-9051814c108e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:58:10.339506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:10.343048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:10.344092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 628/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:58:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:10.346656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81106b1c-30dc-4f6d-ab3f-66906cad34c6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:10.364523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:10.573586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81106b1c-30dc-4f6d-ab3f-66906cad34c6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:10.607735 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e27879-4d40-4cb1-bc12-e4c0c36e3232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:10.608395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e27879-4d40-4cb1-bc12-e4c0c36e3232 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:10.608674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e27879-4d40-4cb1-bc12-e4c0c36e3232 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:10.608943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e27879-4d40-4cb1-bc12-e4c0c36e3232 None admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:10.609683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e27879-4d40-4cb1-bc12-e4c0c36e3232 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:10.609986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e27879-4d40-4cb1-bc12-e4c0c36e3232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:10.611400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e27879-4d40-4cb1-bc12-e4c0c36e3232 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:10.619408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 636/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:10.625351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920ceec-c14a-4374-9be5-9051814c108e None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:10.690255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:10.722440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920ceec-c14a-4374-9be5-9051814c108e None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:10.755274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf96eb9-9f7f-4658-9c54-fd93923ed876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:10.756092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96eb9-9f7f-4658-9c54-fd93923ed876 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:10.756377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96eb9-9f7f-4658-9c54-fd93923ed876 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:10.756648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96eb9-9f7f-4658-9c54-fd93923ed876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:10.768260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf96eb9-9f7f-4658-9c54-fd93923ed876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:10.769713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf96eb9-9f7f-4658-9c54-fd93923ed876 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2cf96eb9-9f7f-4658-9c54-fd93923ed876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:10.786694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:10.787796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:10.789039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:10.789039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:10.789039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:10.789039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:10.789039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 629/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:10.793732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e27879-4d40-4cb1-bc12-e4c0c36e3232 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:10.873389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:10.891950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e27879-4d40-4cb1-bc12-e4c0c36e3232 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:10.924634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd780b40-b8dd-46a8-90cc-20db637036b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:10.925291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd780b40-b8dd-46a8-90cc-20db637036b9 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:10.925573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd780b40-b8dd-46a8-90cc-20db637036b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:10.925848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd780b40-b8dd-46a8-90cc-20db637036b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:10.926561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd780b40-b8dd-46a8-90cc-20db637036b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:10.926866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd780b40-b8dd-46a8-90cc-20db637036b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:10.928248 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd780b40-b8dd-46a8-90cc-20db637036b9 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:10.939534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 637/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:10.945272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf96eb9-9f7f-4658-9c54-fd93923ed876 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:11.043858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf96eb9-9f7f-4658-9c54-fd93923ed876 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:11.063164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:11.076531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a742b2b-af22-4f3d-a99a-a709555c2a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:11.077312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742b2b-af22-4f3d-a99a-a709555c2a7b None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:11.077591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742b2b-af22-4f3d-a99a-a709555c2a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:11.077865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742b2b-af22-4f3d-a99a-a709555c2a7b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:11.085093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a742b2b-af22-4f3d-a99a-a709555c2a7b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:11.086505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a742b2b-af22-4f3d-a99a-a709555c2a7b None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-9a742b2b-af22-4f3d-a99a-a709555c2a7b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:58:11.100263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:11.101411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:11.103218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 630/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:58:11.107804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd780b40-b8dd-46a8-90cc-20db637036b9 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:11.207626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd780b40-b8dd-46a8-90cc-20db637036b9 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:11.240408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efca70-90f6-468b-9ec5-7cffbcbabdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:11.241063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efca70-90f6-468b-9ec5-7cffbcbabdec None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:11.241344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efca70-90f6-468b-9ec5-7cffbcbabdec None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:11.241617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efca70-90f6-468b-9ec5-7cffbcbabdec None admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:11.243028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efca70-90f6-468b-9ec5-7cffbcbabdec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:11.243361 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efca70-90f6-468b-9ec5-7cffbcbabdec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:11.244781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efca70-90f6-468b-9ec5-7cffbcbabdec None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:11.253474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:11.261790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 638/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 2 09:58:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:58:11.267611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a742b2b-af22-4f3d-a99a-a709555c2a7b None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:11.365091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a742b2b-af22-4f3d-a99a-a709555c2a7b None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:11.397677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac108e0-0b24-4801-a902-39cf3e66036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:11.398438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac108e0-0b24-4801-a902-39cf3e66036f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:11.398748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac108e0-0b24-4801-a902-39cf3e66036f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:11.399079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac108e0-0b24-4801-a902-39cf3e66036f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:11.409986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac108e0-0b24-4801-a902-39cf3e66036f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:11.411514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac108e0-0b24-4801-a902-39cf3e66036f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-7ac108e0-0b24-4801-a902-39cf3e66036f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:11.428619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:11.435369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:11.436486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:11.436486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:11.436486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:11.436486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:11.436486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 631/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:11.436830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efca70-90f6-468b-9ec5-7cffbcbabdec None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:11.533826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efca70-90f6-468b-9ec5-7cffbcbabdec None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:11.567213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330b380-326d-4dec-abf9-0e7c56873a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:11.567861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330b380-326d-4dec-abf9-0e7c56873a34 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:11.568137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330b380-326d-4dec-abf9-0e7c56873a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:11.568404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330b380-326d-4dec-abf9-0e7c56873a34 None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:11.569140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330b380-326d-4dec-abf9-0e7c56873a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:11.569442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330b380-326d-4dec-abf9-0e7c56873a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:11.570829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330b380-326d-4dec-abf9-0e7c56873a34 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:11.581886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 639/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:11.588372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac108e0-0b24-4801-a902-39cf3e66036f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:11.619988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:11.686132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac108e0-0b24-4801-a902-39cf3e66036f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:11.719474 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098fec5-6310-45f5-a0fd-39466cf1119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:11.720260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098fec5-6310-45f5-a0fd-39466cf1119f None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:11.720541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098fec5-6310-45f5-a0fd-39466cf1119f None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:11.720811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098fec5-6310-45f5-a0fd-39466cf1119f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:11.728140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098fec5-6310-45f5-a0fd-39466cf1119f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:11.729579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098fec5-6310-45f5-a0fd-39466cf1119f None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-2098fec5-6310-45f5-a0fd-39466cf1119f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:58:11.743655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:11.744747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:11.745824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:58:11.745824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:58:11.745824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:58:11.745824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:58:11.745824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:58:11.745824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:58:11.745824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:11.745824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:11.745824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 632/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:58:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:11.750994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330b380-326d-4dec-abf9-0e7c56873a34 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:11.808328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:11.850792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330b380-326d-4dec-abf9-0e7c56873a34 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:11.884659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b54a7c-bed9-474b-b26e-362c108749de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:11.885303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b54a7c-bed9-474b-b26e-362c108749de None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:11.885577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b54a7c-bed9-474b-b26e-362c108749de None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:11.885869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b54a7c-bed9-474b-b26e-362c108749de None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:11.886637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b54a7c-bed9-474b-b26e-362c108749de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:11.886980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b54a7c-bed9-474b-b26e-362c108749de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:11.888443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b54a7c-bed9-474b-b26e-362c108749de None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:11.900929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 640/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:58:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:11.906818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098fec5-6310-45f5-a0fd-39466cf1119f None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:11.997148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:12.005441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098fec5-6310-45f5-a0fd-39466cf1119f None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:12.039296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f36e9-0392-446b-9bb8-151810968fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:12.040214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f36e9-0392-446b-9bb8-151810968fad None admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:12.040492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f36e9-0392-446b-9bb8-151810968fad None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:12.040761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f36e9-0392-446b-9bb8-151810968fad None admin] PATH_INFO: `/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/bef7eacc5dc0445fa3297db10c8b4d4c/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:12.042786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f36e9-0392-446b-9bb8-151810968fad None admin] RBAC: Authorizing `identity:create_grant(project_id=4933deccae2a46cc94f52fe67bd991a1, user_id=bef7eacc5dc0445fa3297db10c8b4d4c, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:12.044336 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f36e9-0392-446b-9bb8-151810968fad None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:12.103479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 633/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Thu Jun 2 09:58:11 2022] PUT /identity/v3/projects/4933deccae2a46cc94f52fe67bd991a1/users/bef7eacc5dc0445fa3297db10c8b4d4c/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:58:14.301029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54dac9-4067-4411-81c1-46f652a059fa None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:14.301503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54dac9-4067-4411-81c1-46f652a059fa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:14.301593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54dac9-4067-4411-81c1-46f652a059fa None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:14.303153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 641/1274] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:14.309068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cf973-71ae-4e72-ae78-2554288e4710 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:14.309489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cf973-71ae-4e72-ae78-2554288e4710 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:14.309597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cf973-71ae-4e72-ae78-2554288e4710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:14.325639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-184cf973-71ae-4e72-ae78-2554288e4710 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:14.327051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-184cf973-71ae-4e72-ae78-2554288e4710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:14.391188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 634/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:14.414529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54dac9-4067-4411-81c1-46f652a059fa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:14.514576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54dac9-4067-4411-81c1-46f652a059fa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:14.534609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:14.551698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b66285-0837-4540-ad57-8594b74fd821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:14.552509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66285-0837-4540-ad57-8594b74fd821 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:14.552789 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66285-0837-4540-ad57-8594b74fd821 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:14.553061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66285-0837-4540-ad57-8594b74fd821 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:14.562849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b66285-0837-4540-ad57-8594b74fd821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-45b66285-0837-4540-ad57-8594b74fd821 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:58:14.570465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:14.571623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:14.572495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 642/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Thu Jun 2 09:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:14.577881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cf973-71ae-4e72-ae78-2554288e4710 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:14.658880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:14.676686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cf973-71ae-4e72-ae78-2554288e4710 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:14.708985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351203e0-e113-4f31-9f3f-bb6961d7e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:14.709703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351203e0-e113-4f31-9f3f-bb6961d7e66c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:14.709986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351203e0-e113-4f31-9f3f-bb6961d7e66c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:14.710260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351203e0-e113-4f31-9f3f-bb6961d7e66c None admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:14.710995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351203e0-e113-4f31-9f3f-bb6961d7e66c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:14.711334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351203e0-e113-4f31-9f3f-bb6961d7e66c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:14.713182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351203e0-e113-4f31-9f3f-bb6961d7e66c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:14.722017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 635/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Thu Jun 2 09:58:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:14.727732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b66285-0837-4540-ad57-8594b74fd821 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:14.827516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b66285-0837-4540-ad57-8594b74fd821 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:14.860509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951374e6-be47-496c-86d8-ffb6e4e9daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:14.861288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951374e6-be47-496c-86d8-ffb6e4e9daa1 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:14.861573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951374e6-be47-496c-86d8-ffb6e4e9daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:14.861848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951374e6-be47-496c-86d8-ffb6e4e9daa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:14.872435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951374e6-be47-496c-86d8-ffb6e4e9daa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:14.873955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951374e6-be47-496c-86d8-ffb6e4e9daa1 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-951374e6-be47-496c-86d8-ffb6e4e9daa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:14.891429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:14.892327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:14.893282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:14.893282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:14.893282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:14.893282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:14.893282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 643/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:14.898451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351203e0-e113-4f31-9f3f-bb6961d7e66c None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:14.996137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351203e0-e113-4f31-9f3f-bb6961d7e66c None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:15.029661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db54fa9-e28b-49d8-b9f9-c72f4c40fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:15.030331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db54fa9-e28b-49d8-b9f9-c72f4c40fc4a None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:15.030614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db54fa9-e28b-49d8-b9f9-c72f4c40fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:15.030889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db54fa9-e28b-49d8-b9f9-c72f4c40fc4a None admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:15.031631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db54fa9-e28b-49d8-b9f9-c72f4c40fc4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:15.031936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db54fa9-e28b-49d8-b9f9-c72f4c40fc4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:15.033304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db54fa9-e28b-49d8-b9f9-c72f4c40fc4a None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:15.044923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 636/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:15.050610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951374e6-be47-496c-86d8-ffb6e4e9daa1 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:15.084538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:15.148644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951374e6-be47-496c-86d8-ffb6e4e9daa1 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:15.183223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779d7c0-a66c-4504-8459-ddbaf69cf426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:15.187859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779d7c0-a66c-4504-8459-ddbaf69cf426 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:15.187859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779d7c0-a66c-4504-8459-ddbaf69cf426 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:15.187859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779d7c0-a66c-4504-8459-ddbaf69cf426 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:15.192133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779d7c0-a66c-4504-8459-ddbaf69cf426 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:15.193676 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779d7c0-a66c-4504-8459-ddbaf69cf426 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-6779d7c0-a66c-4504-8459-ddbaf69cf426 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:58:15.208734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:15.209856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:15.210846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 644/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:15.215823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db54fa9-e28b-49d8-b9f9-c72f4c40fc4a None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:15.219649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:15.313253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db54fa9-e28b-49d8-b9f9-c72f4c40fc4a None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:15.346247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8d9b2-d8e8-433e-87f7-7a6839fa14ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:15.346849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d9b2-d8e8-433e-87f7-7a6839fa14ef None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:15.347155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d9b2-d8e8-433e-87f7-7a6839fa14ef None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:15.347428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d9b2-d8e8-433e-87f7-7a6839fa14ef None admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:15.348251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8d9b2-d8e8-433e-87f7-7a6839fa14ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:15.348559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8d9b2-d8e8-433e-87f7-7a6839fa14ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:15.349980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8d9b2-d8e8-433e-87f7-7a6839fa14ef None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:15.366370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 637/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Thu Jun 2 09:58:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:15.372660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779d7c0-a66c-4504-8459-ddbaf69cf426 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:15.460999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:15.470380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779d7c0-a66c-4504-8459-ddbaf69cf426 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:15.502704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caa09f-3fbf-4b8f-ae0b-461dd8052e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:15.503376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caa09f-3fbf-4b8f-ae0b-461dd8052e72 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:15.503656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caa09f-3fbf-4b8f-ae0b-461dd8052e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:15.503925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caa09f-3fbf-4b8f-ae0b-461dd8052e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:15.570178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caa09f-3fbf-4b8f-ae0b-461dd8052e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:15.571634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caa09f-3fbf-4b8f-ae0b-461dd8052e72 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:15.657423 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:15.667669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 645/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Thu Jun 2 09:58:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:58:15.673433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8d9b2-d8e8-433e-87f7-7a6839fa14ef None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:15.734079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:15.771861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8d9b2-d8e8-433e-87f7-7a6839fa14ef None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:15.804690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a08ba-f6a0-4325-93a8-6a683811a768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:15.805474 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a08ba-f6a0-4325-93a8-6a683811a768 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:15.805756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a08ba-f6a0-4325-93a8-6a683811a768 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:15.806027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a08ba-f6a0-4325-93a8-6a683811a768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:15.816382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a08ba-f6a0-4325-93a8-6a683811a768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:15.817795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a08ba-f6a0-4325-93a8-6a683811a768 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-208a08ba-f6a0-4325-93a8-6a683811a768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:15.834619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:15.835638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:15.836564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:15.836564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:15.836564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:15.836564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:15.836564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 638/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:15.841866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caa09f-3fbf-4b8f-ae0b-461dd8052e72 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:15.939723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caa09f-3fbf-4b8f-ae0b-461dd8052e72 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:15.973114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e962cc-dae1-4a71-9d9f-5e9a8069e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:15.973761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e962cc-dae1-4a71-9d9f-5e9a8069e01e None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:15.974040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e962cc-dae1-4a71-9d9f-5e9a8069e01e None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:15.974310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e962cc-dae1-4a71-9d9f-5e9a8069e01e None admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:15.975067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e962cc-dae1-4a71-9d9f-5e9a8069e01e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:15.975437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e962cc-dae1-4a71-9d9f-5e9a8069e01e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:15.976787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e962cc-dae1-4a71-9d9f-5e9a8069e01e None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:15.988348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 646/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:15.994027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a08ba-f6a0-4325-93a8-6a683811a768 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:16.092230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a08ba-f6a0-4325-93a8-6a683811a768 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:16.106315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:16.125234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe6361-8126-45e7-86cf-a7ee52f32680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:16.126012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe6361-8126-45e7-86cf-a7ee52f32680 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:16.126292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe6361-8126-45e7-86cf-a7ee52f32680 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:16.126566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe6361-8126-45e7-86cf-a7ee52f32680 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:16.133230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe6361-8126-45e7-86cf-a7ee52f32680 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:16.134654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe6361-8126-45e7-86cf-a7ee52f32680 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application [None req-73fe6361-8126-45e7-86cf-a7ee52f32680 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:58:16.148726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:16.149779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:16.151504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:58:16.151504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:58:16.151504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:58:16.151504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:58:16.151504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:58:16.151504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:58:16.151504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:16.151504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: ERROR keystone.server.flask.application Jun 02 09:58:16.151504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 639/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Thu Jun 2 09:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:58:16.156172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e962cc-dae1-4a71-9d9f-5e9a8069e01e None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:16.205466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:16.254126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e962cc-dae1-4a71-9d9f-5e9a8069e01e None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:16.288133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e35c5-3c8f-499b-a7e0-88d54fa9d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:16.288813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e35c5-3c8f-499b-a7e0-88d54fa9d20b None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:16.289117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e35c5-3c8f-499b-a7e0-88d54fa9d20b None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:16.289388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e35c5-3c8f-499b-a7e0-88d54fa9d20b None admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:16.290162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e35c5-3c8f-499b-a7e0-88d54fa9d20b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:16.290466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e35c5-3c8f-499b-a7e0-88d54fa9d20b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:16.292577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e35c5-3c8f-499b-a7e0-88d54fa9d20b None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:16.304358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 647/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Thu Jun 2 09:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:58:16.310392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe6361-8126-45e7-86cf-a7ee52f32680 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:16.406412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe6361-8126-45e7-86cf-a7ee52f32680 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:16.438181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe426da3-e72e-449a-a4ff-3eee54a24145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:16.438817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426da3-e72e-449a-a4ff-3eee54a24145 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:16.440851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426da3-e72e-449a-a4ff-3eee54a24145 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:16.440851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426da3-e72e-449a-a4ff-3eee54a24145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:16.440851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe426da3-e72e-449a-a4ff-3eee54a24145 None admin] RBAC: Adding query filter params (role.id=a66072a83471483cacbe6d6ebd19ce3f, scope.project.id=4933deccae2a46cc94f52fe67bd991a1, user.id=bef7eacc5dc0445fa3297db10c8b4d4c) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:16.440851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe426da3-e72e-449a-a4ff-3eee54a24145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:16.441909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe426da3-e72e-449a-a4ff-3eee54a24145 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:16.447550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 640/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Thu Jun 2 09:58:16 2022] GET /identity/v3/role_assignments?user.id=bef7eacc5dc0445fa3297db10c8b4d4c&scope.project.id=4933deccae2a46cc94f52fe67bd991a1&role.id=a66072a83471483cacbe6d6ebd19ce3f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:18.739287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7d26-d650-4e47-a28e-d507399e3ce7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:18.739871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7d26-d650-4e47-a28e-d507399e3ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:18.739871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7d26-d650-4e47-a28e-d507399e3ce7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:18.741177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 648/1288] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:18.748248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eabcd2-790e-4449-9950-069a63736b21 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:18.748685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eabcd2-790e-4449-9950-069a63736b21 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:18.748787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eabcd2-790e-4449-9950-069a63736b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:18.765877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d6eabcd2-790e-4449-9950-069a63736b21 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:18.767043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d6eabcd2-790e-4449-9950-069a63736b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:18.796079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:18.833726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 641/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:58:18.856313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee7d26-d650-4e47-a28e-d507399e3ce7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:18.955449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee7d26-d650-4e47-a28e-d507399e3ce7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:18.966367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:18.989533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8646a6-4b90-42d9-91b7-545066c88ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:18.990259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8646a6-4b90-42d9-91b7-545066c88ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:18.990539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8646a6-4b90-42d9-91b7-545066c88ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:18.990815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8646a6-4b90-42d9-91b7-545066c88ca5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:18.991495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8646a6-4b90-42d9-91b7-545066c88ca5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:18.992871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8646a6-4b90-42d9-91b7-545066c88ca5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-dd8646a6-4b90-42d9-91b7-545066c88ca5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:19.004435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:19.005665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:19.006803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 649/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:58:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:19.011661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eabcd2-790e-4449-9950-069a63736b21 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:19.107395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eabcd2-790e-4449-9950-069a63736b21 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:19.140124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1052243-40d5-4857-9db5-a76bfe4d264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:19.140804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1052243-40d5-4857-9db5-a76bfe4d264c None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:19.141084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1052243-40d5-4857-9db5-a76bfe4d264c None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:19.141359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1052243-40d5-4857-9db5-a76bfe4d264c None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:19.142051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1052243-40d5-4857-9db5-a76bfe4d264c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:19.142354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1052243-40d5-4857-9db5-a76bfe4d264c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:19.143737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1052243-40d5-4857-9db5-a76bfe4d264c None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:19.148522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 642/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 2 09:58:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:19.154810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8646a6-4b90-42d9-91b7-545066c88ca5 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:19.252588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8646a6-4b90-42d9-91b7-545066c88ca5 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:19.285417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c078f75-2e49-4fcf-ae1b-588aa61160cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:19.286073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078f75-2e49-4fcf-ae1b-588aa61160cc None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:19.286351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078f75-2e49-4fcf-ae1b-588aa61160cc None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:19.286627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c078f75-2e49-4fcf-ae1b-588aa61160cc None admin] PATH_INFO: `/v3/services` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:19.287352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078f75-2e49-4fcf-ae1b-588aa61160cc None admin] RBAC: Adding query filter params (type=placement) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:19.293782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078f75-2e49-4fcf-ae1b-588aa61160cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:19.293782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c078f75-2e49-4fcf-ae1b-588aa61160cc None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:19.295240 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 650/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 2 09:58:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:21.495778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470a5ca-2542-43bc-9c50-f61988983da5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:21.496323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470a5ca-2542-43bc-9c50-f61988983da5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:21.496439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470a5ca-2542-43bc-9c50-f61988983da5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:21.498199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 643/1293] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:21.503399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8e4ee-edfe-4843-a402-b2b154c345c3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:21.503851 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8e4ee-edfe-4843-a402-b2b154c345c3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:21.504027 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8e4ee-edfe-4843-a402-b2b154c345c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:21.521952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a0b8e4ee-edfe-4843-a402-b2b154c345c3 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:21.523069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a0b8e4ee-edfe-4843-a402-b2b154c345c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:21.552244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:21.588400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 651/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:21.611354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470a5ca-2542-43bc-9c50-f61988983da5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:21.642029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:21.708377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470a5ca-2542-43bc-9c50-f61988983da5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:21.742024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c87ec-85b2-4666-a296-4b0d4d81a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:21.742683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c87ec-85b2-4666-a296-4b0d4d81a843 None admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:21.742962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c87ec-85b2-4666-a296-4b0d4d81a843 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:21.743262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c87ec-85b2-4666-a296-4b0d4d81a843 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:21.743979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c87ec-85b2-4666-a296-4b0d4d81a843 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:21.745316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c87ec-85b2-4666-a296-4b0d4d81a843 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:21.836730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 644/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Thu Jun 2 09:58:21 2022] POST /identity/v3/services => generated 246 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:58:24.054188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa22cd-4ea1-4cca-bfb2-e5c0dc0df38d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:24.054781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa22cd-4ea1-4cca-bfb2-e5c0dc0df38d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:24.054781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa22cd-4ea1-4cca-bfb2-e5c0dc0df38d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:24.056124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 652/1296] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:24.061438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5612de-9e57-4519-bc22-06a4076d6260 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:24.061869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5612de-9e57-4519-bc22-06a4076d6260 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:24.062024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5612de-9e57-4519-bc22-06a4076d6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:24.078941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1c5612de-9e57-4519-bc22-06a4076d6260 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:24.080407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1c5612de-9e57-4519-bc22-06a4076d6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:24.150981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 645/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:24.173761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa22cd-4ea1-4cca-bfb2-e5c0dc0df38d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:24.273776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa22cd-4ea1-4cca-bfb2-e5c0dc0df38d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:24.306317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea181615-57af-44c4-81b5-24c3e8a8cbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:24.307037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea181615-57af-44c4-81b5-24c3e8a8cbef None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:24.307340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea181615-57af-44c4-81b5-24c3e8a8cbef None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:24.307613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea181615-57af-44c4-81b5-24c3e8a8cbef None admin] PATH_INFO: `/v3/services/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:24.308253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea181615-57af-44c4-81b5-24c3e8a8cbef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:24.309606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea181615-57af-44c4-81b5-24c3e8a8cbef None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-ea181615-57af-44c4-81b5-24c3e8a8cbef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:24.321551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:24.322630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:24.323538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 653/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:58:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:24.329495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5612de-9e57-4519-bc22-06a4076d6260 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:24.347778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:24.425415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5612de-9e57-4519-bc22-06a4076d6260 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:24.459160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32315-a3ba-41ed-8596-ac7ab882c359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:24.459820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32315-a3ba-41ed-8596-ac7ab882c359 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:24.460098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32315-a3ba-41ed-8596-ac7ab882c359 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:24.460370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32315-a3ba-41ed-8596-ac7ab882c359 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:24.461063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32315-a3ba-41ed-8596-ac7ab882c359 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:24.461366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32315-a3ba-41ed-8596-ac7ab882c359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:24.462711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32315-a3ba-41ed-8596-ac7ab882c359 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:24.467742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 646/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 2 09:58:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:24.473817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea181615-57af-44c4-81b5-24c3e8a8cbef None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:24.504439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:24.574753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea181615-57af-44c4-81b5-24c3e8a8cbef None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:24.612687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cddb7-50c4-4201-8106-ad1fb39aefb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:24.613335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cddb7-50c4-4201-8106-ad1fb39aefb7 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:24.613619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cddb7-50c4-4201-8106-ad1fb39aefb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:24.613894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cddb7-50c4-4201-8106-ad1fb39aefb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:24.614679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cddb7-50c4-4201-8106-ad1fb39aefb7 None admin] RBAC: Adding query filter params (interface=public, service_id=3ee87ada35434ecbb079db714fb60e7a, region_id=RegionOne) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:24.614994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cddb7-50c4-4201-8106-ad1fb39aefb7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:24.616379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cddb7-50c4-4201-8106-ad1fb39aefb7 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:24.621395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 654/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Thu Jun 2 09:58:24 2022] GET /identity/v3/endpoints?service_id=3ee87ada35434ecbb079db714fb60e7a&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:24.627793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32315-a3ba-41ed-8596-ac7ab882c359 None admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:24.706429 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:24.723293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32315-a3ba-41ed-8596-ac7ab882c359 None admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:24.756601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f17862-b131-4f23-96c7-e9452024551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:24.757253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17862-b131-4f23-96c7-e9452024551e None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:24.757529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17862-b131-4f23-96c7-e9452024551e None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:24.757801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17862-b131-4f23-96c7-e9452024551e None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:24.758467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17862-b131-4f23-96c7-e9452024551e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:24.759866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17862-b131-4f23-96c7-e9452024551e None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:24.767001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 647/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Thu Jun 2 09:58:24 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:58:26.995197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68256d2-9e6c-4792-9fda-031aa0f3f553 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:26.995763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68256d2-9e6c-4792-9fda-031aa0f3f553 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:26.995763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68256d2-9e6c-4792-9fda-031aa0f3f553 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:26.997098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 655/1302] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 09:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:27.002342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e86ea-fa84-4a52-95ce-1a09cfbb47e6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:27.002786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e86ea-fa84-4a52-95ce-1a09cfbb47e6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:27.002882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e86ea-fa84-4a52-95ce-1a09cfbb47e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:27.020353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f98e86ea-fa84-4a52-95ce-1a09cfbb47e6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:27.021538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f98e86ea-fa84-4a52-95ce-1a09cfbb47e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:27.087765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 648/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:27.111288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68256d2-9e6c-4792-9fda-031aa0f3f553 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:27.203634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:27.210336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68256d2-9e6c-4792-9fda-031aa0f3f553 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:27.242607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78706f03-c93e-48f2-a5e2-203e9af3fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:27.243446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78706f03-c93e-48f2-a5e2-203e9af3fc46 None admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:27.243728 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78706f03-c93e-48f2-a5e2-203e9af3fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:27.244021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78706f03-c93e-48f2-a5e2-203e9af3fc46 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:27.244670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78706f03-c93e-48f2-a5e2-203e9af3fc46 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:27.246075 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78706f03-c93e-48f2-a5e2-203e9af3fc46 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application [None req-78706f03-c93e-48f2-a5e2-203e9af3fc46 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:27.258270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:27.259507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: ERROR keystone.server.flask.application Jun 02 09:58:27.260411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 656/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Thu Jun 2 09:58:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:27.266158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e86ea-fa84-4a52-95ce-1a09cfbb47e6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:27.341127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:27.362635 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e86ea-fa84-4a52-95ce-1a09cfbb47e6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:27.395762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976f63d-d48f-4d6e-a2c0-b15ed69b3b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:27.396416 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976f63d-d48f-4d6e-a2c0-b15ed69b3b71 None admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:27.396695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976f63d-d48f-4d6e-a2c0-b15ed69b3b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:27.396965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976f63d-d48f-4d6e-a2c0-b15ed69b3b71 None admin] PATH_INFO: `/v3/services` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:27.397659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976f63d-d48f-4d6e-a2c0-b15ed69b3b71 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:27.397960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976f63d-d48f-4d6e-a2c0-b15ed69b3b71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:27.399378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976f63d-d48f-4d6e-a2c0-b15ed69b3b71 None admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:27.404403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 649/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Thu Jun 2 09:58:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:27.410318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78706f03-c93e-48f2-a5e2-203e9af3fc46 None admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:27.516743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78706f03-c93e-48f2-a5e2-203e9af3fc46 None admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:27.549155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898ed53-1ea5-4acb-a179-fe92e03a3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:27.549794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898ed53-1ea5-4acb-a179-fe92e03a3bb5 None admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:27.550073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898ed53-1ea5-4acb-a179-fe92e03a3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:27.550343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898ed53-1ea5-4acb-a179-fe92e03a3bb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:27.551064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898ed53-1ea5-4acb-a179-fe92e03a3bb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:27.552536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898ed53-1ea5-4acb-a179-fe92e03a3bb5 None admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:27.632736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 657/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Thu Jun 2 09:58:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:58:37.401371 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=30 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:37.628398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:30.509375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e78a50-4589-47b1-a8c6-631731a69a52 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:30.509922 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e78a50-4589-47b1-a8c6-631731a69a52 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:30.509922 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e78a50-4589-47b1-a8c6-631731a69a52 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:30.517456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aefa50-8aad-44fc-89b0-5b908fb8b5e6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:30.517897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aefa50-8aad-44fc-89b0-5b908fb8b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:30.518012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aefa50-8aad-44fc-89b0-5b908fb8b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:30.521204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 650/1307] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:30.598506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-98aefa50-8aad-44fc-89b0-5b908fb8b5e6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:30.599748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-98aefa50-8aad-44fc-89b0-5b908fb8b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:30.722317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 658/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:30.786839 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476001-0d36-461d-85e6-9306d3e152f5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:30.787183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476001-0d36-461d-85e6-9306d3e152f5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:30.787425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8476001-0d36-461d-85e6-9306d3e152f5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:30.788797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 651/1309] 10.222.0.13 () {54 vars in 964 bytes} [Thu Jun 2 10:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:30.801832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e4df-2132-4a3e-9533-f761aedbc937 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:30.802451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e4df-2132-4a3e-9533-f761aedbc937 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:30.803042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e4df-2132-4a3e-9533-f761aedbc937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:31.079999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7081e4df-2132-4a3e-9533-f761aedbc937 None None] MFA Rules not processed for user `4bc0ef455caa4ee5b6b86dc1904d4e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:31.081403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7081e4df-2132-4a3e-9533-f761aedbc937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:31.105032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:31.207156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 659/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Jun 2 10:04:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:31.209028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8476001-0d36-461d-85e6-9306d3e152f5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:31.211077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c8476001-0d36-461d-85e6-9306d3e152f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:31.349082 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8476001-0d36-461d-85e6-9306d3e152f5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:31.429290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27e9a5-3a79-4f61-854c-039a52966248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:31.429952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27e9a5-3a79-4f61-854c-039a52966248 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:31.430232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27e9a5-3a79-4f61-854c-039a52966248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:31.430501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27e9a5-3a79-4f61-854c-039a52966248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:31.432175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6b27e9a5-3a79-4f61-854c-039a52966248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:31.490032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:31.550607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27e9a5-3a79-4f61-854c-039a52966248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:31.552069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27e9a5-3a79-4f61-854c-039a52966248 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:31.575636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 652/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:34.173720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980bc7-135a-47fb-a84b-c7701b91bc59 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:34.174162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980bc7-135a-47fb-a84b-c7701b91bc59 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:34.174263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980bc7-135a-47fb-a84b-c7701b91bc59 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:34.175910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 660/1312] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:34.181177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd665f-edf6-4b06-84b9-68ca475e1479 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:34.181607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd665f-edf6-4b06-84b9-68ca475e1479 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:34.181727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd665f-edf6-4b06-84b9-68ca475e1479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:34.270547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b4dd665f-edf6-4b06-84b9-68ca475e1479 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:34.271782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b4dd665f-edf6-4b06-84b9-68ca475e1479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:34.381052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 653/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:34.419444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1980bc7-135a-47fb-a84b-c7701b91bc59 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:34.421011 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f1980bc7-135a-47fb-a84b-c7701b91bc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:34.523513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1980bc7-135a-47fb-a84b-c7701b91bc59 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:34.596596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:34.599274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf4e11-c599-49fe-82bc-615bba20f2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:34.599967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4e11-c599-49fe-82bc-615bba20f2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:34.604007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4e11-c599-49fe-82bc-615bba20f2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:34.604007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4e11-c599-49fe-82bc-615bba20f2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:34.604007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9bbf4e11-c599-49fe-82bc-615bba20f2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:34.710285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf4e11-c599-49fe-82bc-615bba20f2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:34.711668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf4e11-c599-49fe-82bc-615bba20f2b4 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:34.730179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 661/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:37.485355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df214b3-da9b-4d96-ac3d-338b2552f87a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:37.485903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df214b3-da9b-4d96-ac3d-338b2552f87a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:37.485903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df214b3-da9b-4d96-ac3d-338b2552f87a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:37.487311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 654/1315] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:37.492441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f1d44-5ffc-40f4-870e-e2435ad47789 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:37.492848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f1d44-5ffc-40f4-870e-e2435ad47789 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:37.492999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f1d44-5ffc-40f4-870e-e2435ad47789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:37.556087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-309f1d44-5ffc-40f4-870e-e2435ad47789 None None] MFA Rules not processed for user `ad64baa998df4ef985f8ebf3cab5798b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:37.557283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-309f1d44-5ffc-40f4-870e-e2435ad47789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:37.607800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:37.652169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 662/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:37.691481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df214b3-da9b-4d96-ac3d-338b2552f87a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:37.693029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7df214b3-da9b-4d96-ac3d-338b2552f87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:37.703239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:37.794502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df214b3-da9b-4d96-ac3d-338b2552f87a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:37.865915 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3b24-0b67-4ce9-bf50-d4bc1011c737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:37.866498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3b24-0b67-4ce9-bf50-d4bc1011c737 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:37.866780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3b24-0b67-4ce9-bf50-d4bc1011c737 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:37.867056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3b24-0b67-4ce9-bf50-d4bc1011c737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:37.868733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-196c3b24-0b67-4ce9-bf50-d4bc1011c737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:37.929715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:37.975414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c3b24-0b67-4ce9-bf50-d4bc1011c737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:37.976841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c3b24-0b67-4ce9-bf50-d4bc1011c737 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:37.995278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 655/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:41.023216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbdeea-7676-4997-b3fd-839dc963dc53 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:41.023742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbdeea-7676-4997-b3fd-839dc963dc53 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:41.023742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbdeea-7676-4997-b3fd-839dc963dc53 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:41.025110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 663/1318] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:41.030758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07852a6-e04d-4e67-a490-bca3e522a83f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:41.031206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07852a6-e04d-4e67-a490-bca3e522a83f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:41.031320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07852a6-e04d-4e67-a490-bca3e522a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:41.095209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b07852a6-e04d-4e67-a490-bca3e522a83f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:41.096421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b07852a6-e04d-4e67-a490-bca3e522a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:41.191124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 656/1319] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:41.241076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbdeea-7676-4997-b3fd-839dc963dc53 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:41.242754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-65cbdeea-7676-4997-b3fd-839dc963dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:41.345307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbdeea-7676-4997-b3fd-839dc963dc53 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:41.416599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9064fe-3b74-4df0-a6c9-da1628fd29cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:41.417233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9064fe-3b74-4df0-a6c9-da1628fd29cb service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:41.417514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9064fe-3b74-4df0-a6c9-da1628fd29cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:41.417786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9064fe-3b74-4df0-a6c9-da1628fd29cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:41.419484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6d9064fe-3b74-4df0-a6c9-da1628fd29cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:41.426752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:41.528109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9064fe-3b74-4df0-a6c9-da1628fd29cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:41.529543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9064fe-3b74-4df0-a6c9-da1628fd29cb service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:41.547014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 664/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:44.723978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebd8a0-b4a2-42ff-8efb-1e65a151998e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:44.724516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebd8a0-b4a2-42ff-8efb-1e65a151998e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:44.724516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebd8a0-b4a2-42ff-8efb-1e65a151998e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:44.725866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 657/1321] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:44.731263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad7d79-6756-4b91-947d-bdeaf02f7006 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:44.731692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad7d79-6756-4b91-947d-bdeaf02f7006 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:44.731820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad7d79-6756-4b91-947d-bdeaf02f7006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:44.796318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ddad7d79-6756-4b91-947d-bdeaf02f7006 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:44.797487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ddad7d79-6756-4b91-947d-bdeaf02f7006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:44.857763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:44.898072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 665/1322] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:44.933425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebd8a0-b4a2-42ff-8efb-1e65a151998e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:44.935473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-51ebd8a0-b4a2-42ff-8efb-1e65a151998e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:44.954622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:45.037077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebd8a0-b4a2-42ff-8efb-1e65a151998e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:45.108608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c90da-99d2-46b2-b411-3bd218cd87f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:45.109250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c90da-99d2-46b2-b411-3bd218cd87f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:45.109526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c90da-99d2-46b2-b411-3bd218cd87f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:45.109794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c90da-99d2-46b2-b411-3bd218cd87f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:45.111449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-316c90da-99d2-46b2-b411-3bd218cd87f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:45.180997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:45.222400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c90da-99d2-46b2-b411-3bd218cd87f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:45.223851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c90da-99d2-46b2-b411-3bd218cd87f8 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:45.242032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 658/1323] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:47.549813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087ab5-a415-46bd-8b31-5822b5011f44 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:47.550372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087ab5-a415-46bd-8b31-5822b5011f44 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:47.550372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087ab5-a415-46bd-8b31-5822b5011f44 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:47.551933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 666/1324] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:47.557289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d8cc-d13b-4ebb-b5cb-5c55fcd2ba40 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:47.557852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d8cc-d13b-4ebb-b5cb-5c55fcd2ba40 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:47.558126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d8cc-d13b-4ebb-b5cb-5c55fcd2ba40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:47.622392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7d83d8cc-d13b-4ebb-b5cb-5c55fcd2ba40 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:47.623622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7d83d8cc-d13b-4ebb-b5cb-5c55fcd2ba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:47.719532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 659/1325] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:47.754775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00087ab5-a415-46bd-8b31-5822b5011f44 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:47.756354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-00087ab5-a415-46bd-8b31-5822b5011f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:47.858543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00087ab5-a415-46bd-8b31-5822b5011f44 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:47.932037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ccfa5-0616-4220-8c44-5e231991eab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:47.932677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ccfa5-0616-4220-8c44-5e231991eab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:47.932960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ccfa5-0616-4220-8c44-5e231991eab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:47.933236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ccfa5-0616-4220-8c44-5e231991eab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:47.934907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a81ccfa5-0616-4220-8c44-5e231991eab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:47.952017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:48.045025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ccfa5-0616-4220-8c44-5e231991eab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:48.046456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ccfa5-0616-4220-8c44-5e231991eab8 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:48.064436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 667/1326] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:50.344829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fb6f-b8c2-46ee-92e2-317425a54c1f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:50.345386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fb6f-b8c2-46ee-92e2-317425a54c1f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:50.345386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fb6f-b8c2-46ee-92e2-317425a54c1f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:50.346748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 660/1327] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:50.352098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3a3c-1ebc-4aee-8212-ac29c2c52356 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:50.352483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3a3c-1ebc-4aee-8212-ac29c2c52356 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:50.352656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3a3c-1ebc-4aee-8212-ac29c2c52356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:50.418863 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f72a3a3c-1ebc-4aee-8212-ac29c2c52356 None None] MFA Rules not processed for user `ad64baa998df4ef985f8ebf3cab5798b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:50.420102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f72a3a3c-1ebc-4aee-8212-ac29c2c52356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:50.483716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:50.516885 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 668/1328] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:50.554063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fb6f-b8c2-46ee-92e2-317425a54c1f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:50.555669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b689fb6f-b8c2-46ee-92e2-317425a54c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:50.588446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:50.660828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fb6f-b8c2-46ee-92e2-317425a54c1f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:50.733784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae1e3a-faaa-4b0a-8669-7edec884ac5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:50.734439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1e3a-faaa-4b0a-8669-7edec884ac5c service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:50.734723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1e3a-faaa-4b0a-8669-7edec884ac5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:50.734996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1e3a-faaa-4b0a-8669-7edec884ac5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:50.736671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d7ae1e3a-faaa-4b0a-8669-7edec884ac5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:50.813893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:50.845712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae1e3a-faaa-4b0a-8669-7edec884ac5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:50.847170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae1e3a-faaa-4b0a-8669-7edec884ac5c service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:50.865788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 661/1329] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:53.497663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e55ac4-9c34-44f1-baa8-316a6cf84157 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:53.498166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e55ac4-9c34-44f1-baa8-316a6cf84157 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:53.498265 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e55ac4-9c34-44f1-baa8-316a6cf84157 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:53.502083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 669/1330] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:53.505149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7386bfd-3b09-4c88-abc4-f7e83a3da8eb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:53.505632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7386bfd-3b09-4c88-abc4-f7e83a3da8eb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:53.505723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7386bfd-3b09-4c88-abc4-f7e83a3da8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:53.569176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e7386bfd-3b09-4c88-abc4-f7e83a3da8eb None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:53.570377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e7386bfd-3b09-4c88-abc4-f7e83a3da8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:53.675084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 662/1331] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:53.712302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e55ac4-9c34-44f1-baa8-316a6cf84157 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:53.713838 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-55e55ac4-9c34-44f1-baa8-316a6cf84157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:53.819750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e55ac4-9c34-44f1-baa8-316a6cf84157 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:53.892470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989fb81-cb5b-4126-a0d3-7e6b131256ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:53.893112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989fb81-cb5b-4126-a0d3-7e6b131256ee service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:53.893390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989fb81-cb5b-4126-a0d3-7e6b131256ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:53.893663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989fb81-cb5b-4126-a0d3-7e6b131256ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:53.895336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7989fb81-cb5b-4126-a0d3-7e6b131256ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:53.924651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:54.019049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989fb81-cb5b-4126-a0d3-7e6b131256ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:54.020506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989fb81-cb5b-4126-a0d3-7e6b131256ee service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:54.040277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 670/1332] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:56.331906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4409e-8fce-41d2-b1d5-8db4df93587f None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:56.332439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4409e-8fce-41d2-b1d5-8db4df93587f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:56.332439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4409e-8fce-41d2-b1d5-8db4df93587f None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:56.333810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 663/1333] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:56.339229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0806c10-8bdf-4b3e-a39d-6db41038de80 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:56.339613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0806c10-8bdf-4b3e-a39d-6db41038de80 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:56.339849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0806c10-8bdf-4b3e-a39d-6db41038de80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:56.402997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b0806c10-8bdf-4b3e-a39d-6db41038de80 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:56.404202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b0806c10-8bdf-4b3e-a39d-6db41038de80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:56.477026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:56.499929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 671/1334] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:56.544689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4409e-8fce-41d2-b1d5-8db4df93587f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:56.546502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-71d4409e-8fce-41d2-b1d5-8db4df93587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:56.590076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:56.653773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4409e-8fce-41d2-b1d5-8db4df93587f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:56.853988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e35a6-ec05-411b-bac3-3f8f04a65374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:56.854539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e35a6-ec05-411b-bac3-3f8f04a65374 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:56.854816 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e35a6-ec05-411b-bac3-3f8f04a65374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:56.855706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e35a6-ec05-411b-bac3-3f8f04a65374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:56.857364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-200e35a6-ec05-411b-bac3-3f8f04a65374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:56.941890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:56.970581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e35a6-ec05-411b-bac3-3f8f04a65374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:56.972046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e35a6-ec05-411b-bac3-3f8f04a65374 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:56.991355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 664/1335] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:59.856647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c9cb-52a2-481a-81fa-738d960aa7a7 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:59.857219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c9cb-52a2-481a-81fa-738d960aa7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:59.857219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c9cb-52a2-481a-81fa-738d960aa7a7 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:59.858537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 672/1336] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:59.863899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02720fdc-7a1b-40a0-b3f3-0645feea3fa2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:59.864309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02720fdc-7a1b-40a0-b3f3-0645feea3fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:59.864425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02720fdc-7a1b-40a0-b3f3-0645feea3fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:59.928806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-02720fdc-7a1b-40a0-b3f3-0645feea3fa2 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:59.929985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-02720fdc-7a1b-40a0-b3f3-0645feea3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:00.024394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 665/1337] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:00.060345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581c9cb-52a2-481a-81fa-738d960aa7a7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:00.061862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e581c9cb-52a2-481a-81fa-738d960aa7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:00.161881 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581c9cb-52a2-481a-81fa-738d960aa7a7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:00.233337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9bfa7-cd78-4660-8225-8f1ea344ffd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:00.233966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9bfa7-cd78-4660-8225-8f1ea344ffd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:00.234246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9bfa7-cd78-4660-8225-8f1ea344ffd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:00.234509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9bfa7-cd78-4660-8225-8f1ea344ffd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:00.236242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4ee9bfa7-cd78-4660-8225-8f1ea344ffd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:00.273423 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:00.346785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9bfa7-cd78-4660-8225-8f1ea344ffd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:00.348248 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9bfa7-cd78-4660-8225-8f1ea344ffd0 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:00.366599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 673/1338] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:04.743568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ff8e3-e180-44aa-bd19-448a8bd42660 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:04.743568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ff8e3-e180-44aa-bd19-448a8bd42660 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:04.743568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ff8e3-e180-44aa-bd19-448a8bd42660 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:04.743568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 666/1339] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:04.746893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dbf3e-829d-4abd-915f-8a584144fe84 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:04.747296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dbf3e-829d-4abd-915f-8a584144fe84 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:04.747483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dbf3e-829d-4abd-915f-8a584144fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:04.818259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a90dbf3e-829d-4abd-915f-8a584144fe84 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:04.819420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a90dbf3e-829d-4abd-915f-8a584144fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:04.915705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:04.928769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 674/1340] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:04.967301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ff8e3-e180-44aa-bd19-448a8bd42660 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:04.969387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b71ff8e3-e180-44aa-bd19-448a8bd42660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:05.018461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:05.064462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ff8e3-e180-44aa-bd19-448a8bd42660 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:05.068178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ef213-65f9-4c86-8b12-36b894a05fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:05.068879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ef213-65f9-4c86-8b12-36b894a05fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:05.069108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ef213-65f9-4c86-8b12-36b894a05fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:05.069383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ef213-65f9-4c86-8b12-36b894a05fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:05.078299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ef213-65f9-4c86-8b12-36b894a05fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:05.079744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ef213-65f9-4c86-8b12-36b894a05fa7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:05.090431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 667/1341] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:08.257036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa581b-4262-4465-b4d6-d54e0388ac40 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:08.257555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa581b-4262-4465-b4d6-d54e0388ac40 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:08.257555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa581b-4262-4465-b4d6-d54e0388ac40 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:08.259629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 675/1342] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:08.264948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3da68-06fd-46ef-88c6-42899901b0ca None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:08.271508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3da68-06fd-46ef-88c6-42899901b0ca None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:08.271508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3da68-06fd-46ef-88c6-42899901b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:08.293046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fae3da68-06fd-46ef-88c6-42899901b0ca None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:08.300218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fae3da68-06fd-46ef-88c6-42899901b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:08.373152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 668/1343] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:08.409487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa581b-4262-4465-b4d6-d54e0388ac40 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:08.420993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa581b-4262-4465-b4d6-d54e0388ac40 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:08.424619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd300f9-1f10-4598-87df-ccfa5b954596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:08.425259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd300f9-1f10-4598-87df-ccfa5b954596 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:08.425538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd300f9-1f10-4598-87df-ccfa5b954596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:08.425811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd300f9-1f10-4598-87df-ccfa5b954596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:08.435917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd300f9-1f10-4598-87df-ccfa5b954596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:08.437367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd300f9-1f10-4598-87df-ccfa5b954596 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:08.447154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 676/1344] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:12.814863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c779f-06fb-408a-be1c-1cbfbccc7da2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:12.815464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c779f-06fb-408a-be1c-1cbfbccc7da2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:12.815464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c779f-06fb-408a-be1c-1cbfbccc7da2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:12.816812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 669/1345] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:12.822133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe6b67-f4ed-428d-9c74-fb68c2ef1375 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:12.822558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe6b67-f4ed-428d-9c74-fb68c2ef1375 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:12.822834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe6b67-f4ed-428d-9c74-fb68c2ef1375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:12.840239 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3cbe6b67-f4ed-428d-9c74-fb68c2ef1375 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:12.841440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3cbe6b67-f4ed-428d-9c74-fb68c2ef1375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:12.849337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 677/1346] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:12.887435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c779f-06fb-408a-be1c-1cbfbccc7da2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:12.898401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c779f-06fb-408a-be1c-1cbfbccc7da2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:12.902458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cece8cf-b253-4beb-af36-840778698ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:12.903216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cece8cf-b253-4beb-af36-840778698ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:12.903608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cece8cf-b253-4beb-af36-840778698ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:12.903955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cece8cf-b253-4beb-af36-840778698ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:12.914894 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cece8cf-b253-4beb-af36-840778698ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:12.916492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cece8cf-b253-4beb-af36-840778698ae1 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:12.935244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 670/1347] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:18.408720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c944a-c1aa-426a-a815-aa396dafb84a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:18.409525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c944a-c1aa-426a-a815-aa396dafb84a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:18.409945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c944a-c1aa-426a-a815-aa396dafb84a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:18.411714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 678/1348] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:18.417527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7fb1-4bcf-4e19-b8f7-d725c79cbc56 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:18.418314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7fb1-4bcf-4e19-b8f7-d725c79cbc56 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:18.418765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7fb1-4bcf-4e19-b8f7-d725c79cbc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:18.490390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4b6f7fb1-4bcf-4e19-b8f7-d725c79cbc56 None None] MFA Rules not processed for user `bef7eacc5dc0445fa3297db10c8b4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:18.492088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4b6f7fb1-4bcf-4e19-b8f7-d725c79cbc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:18.519478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:18.571318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 671/1349] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:05:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:22.835128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=13 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:23.054518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00daef8-e8d7-4676-b0a9-f8b740ca211d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:23.054799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00daef8-e8d7-4676-b0a9-f8b740ca211d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:23.055469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00daef8-e8d7-4676-b0a9-f8b740ca211d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:23.057071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 679/1350] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:23.062415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437aaf-7a58-4e8e-ae17-8e5b51750d04 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:23.062890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437aaf-7a58-4e8e-ae17-8e5b51750d04 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:23.063165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437aaf-7a58-4e8e-ae17-8e5b51750d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:23.081525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a3437aaf-7a58-4e8e-ae17-8e5b51750d04 None None] MFA Rules not processed for user `bef7eacc5dc0445fa3297db10c8b4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:23.082718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a3437aaf-7a58-4e8e-ae17-8e5b51750d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:23.092033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 672/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:05:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:24.560224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66816204-6374-4bf5-aa43-ff9c4e56de84 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:24.560752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66816204-6374-4bf5-aa43-ff9c4e56de84 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:24.560752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66816204-6374-4bf5-aa43-ff9c4e56de84 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:24.562119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 680/1352] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:24.567047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e277acf-50ea-49a1-b8e6-772ec9960cb8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:24.567481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e277acf-50ea-49a1-b8e6-772ec9960cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:24.567629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e277acf-50ea-49a1-b8e6-772ec9960cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:24.585986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8e277acf-50ea-49a1-b8e6-772ec9960cb8 None None] MFA Rules not processed for user `bef7eacc5dc0445fa3297db10c8b4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:24.587214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8e277acf-50ea-49a1-b8e6-772ec9960cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:24.596019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 673/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:05:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:28.377284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964dbfa-c09d-49c7-b0f6-a4ebaa66d054 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:28.377849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964dbfa-c09d-49c7-b0f6-a4ebaa66d054 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:28.377849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964dbfa-c09d-49c7-b0f6-a4ebaa66d054 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:28.379469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 681/1354] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:28.384701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062d24-4c8b-4cf8-badd-4cf8e57455da None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:28.387745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062d24-4c8b-4cf8-badd-4cf8e57455da None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:28.387745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062d24-4c8b-4cf8-badd-4cf8e57455da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:28.404082 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a1062d24-4c8b-4cf8-badd-4cf8e57455da None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:28.405460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1062d24-4c8b-4cf8-badd-4cf8e57455da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:28.413732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 674/1355] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:28.468377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8d208-01b7-430b-9794-500952cd6051 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:28.469046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8d208-01b7-430b-9794-500952cd6051 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:28.469594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8d208-01b7-430b-9794-500952cd6051 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:28.472572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 682/1356] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 2 10:05:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:28.481670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc60a80-01d1-463d-a143-47a563f7a74e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:28.482683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc60a80-01d1-463d-a143-47a563f7a74e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:28.483188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc60a80-01d1-463d-a143-47a563f7a74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:28.537101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ecc60a80-01d1-463d-a143-47a563f7a74e None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:28.538405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ecc60a80-01d1-463d-a143-47a563f7a74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:28.629814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 675/1357] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 2 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:28.638379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8d208-01b7-430b-9794-500952cd6051 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:28.654060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8d208-01b7-430b-9794-500952cd6051 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:28.660035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c1037-3940-4918-bae4-9c81da857009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:28.660943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c1037-3940-4918-bae4-9c81da857009 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:28.661443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c1037-3940-4918-bae4-9c81da857009 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:28.661930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c1037-3940-4918-bae4-9c81da857009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:28.672108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c1037-3940-4918-bae4-9c81da857009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:28.673888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c1037-3940-4918-bae4-9c81da857009 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:28.684700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 683/1358] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:05:31.144851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df149-8a89-4330-b005-083e2da6156c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:31.145383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df149-8a89-4330-b005-083e2da6156c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:31.145383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df149-8a89-4330-b005-083e2da6156c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:31.146799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 676/1359] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:05:31.152869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca6d3-5c05-4408-8ddf-37a5a78e1331 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:31.153330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca6d3-5c05-4408-8ddf-37a5a78e1331 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:31.153519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ca6d3-5c05-4408-8ddf-37a5a78e1331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:31.172464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1b4ca6d3-5c05-4408-8ddf-37a5a78e1331 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:31.173846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1b4ca6d3-5c05-4408-8ddf-37a5a78e1331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:31.182691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 684/1360] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:31.226779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df149-8a89-4330-b005-083e2da6156c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:31.242703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df149-8a89-4330-b005-083e2da6156c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:31.249257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef02985-7008-45a2-b904-2b83b40a5e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:31.250022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef02985-7008-45a2-b904-2b83b40a5e17 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:31.250407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef02985-7008-45a2-b904-2b83b40a5e17 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:31.250781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef02985-7008-45a2-b904-2b83b40a5e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:31.264573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef02985-7008-45a2-b904-2b83b40a5e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:31.267828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef02985-7008-45a2-b904-2b83b40a5e17 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:31.279600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 677/1361] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:33.981924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5813bd-e227-40ba-ab26-a4321f435760 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:33.982767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5813bd-e227-40ba-ab26-a4321f435760 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:33.983246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5813bd-e227-40ba-ab26-a4321f435760 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:33.985066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 685/1362] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:33.990929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f9da4-7078-4305-8c93-f15b8aa074c3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:33.991470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f9da4-7078-4305-8c93-f15b8aa074c3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:33.991557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f9da4-7078-4305-8c93-f15b8aa074c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:34.010469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3a2f9da4-7078-4305-8c93-f15b8aa074c3 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:34.011859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3a2f9da4-7078-4305-8c93-f15b8aa074c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:34.019632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 678/1363] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:34.065717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248509b-bdc2-4afb-976f-b8e4cef7ba82 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:34.065997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248509b-bdc2-4afb-976f-b8e4cef7ba82 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:34.066267 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248509b-bdc2-4afb-976f-b8e4cef7ba82 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:34.067631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 686/1364] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 2 10:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:34.074087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a645-9ad2-4639-9901-132cf73a9e0d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:34.074377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a645-9ad2-4639-9901-132cf73a9e0d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:34.074654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a645-9ad2-4639-9901-132cf73a9e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:34.092409 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c7c6a645-9ad2-4639-9901-132cf73a9e0d None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:34.093580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c7c6a645-9ad2-4639-9901-132cf73a9e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:34.102569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 679/1365] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 2 10:05:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:34.110743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248509b-bdc2-4afb-976f-b8e4cef7ba82 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:34.125387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248509b-bdc2-4afb-976f-b8e4cef7ba82 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:34.130668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b253bf-0733-4bca-a667-31e51d45c085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:34.131317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b253bf-0733-4bca-a667-31e51d45c085 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:34.131598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b253bf-0733-4bca-a667-31e51d45c085 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:34.131867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b253bf-0733-4bca-a667-31e51d45c085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:34.139912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b253bf-0733-4bca-a667-31e51d45c085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:34.141464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b253bf-0733-4bca-a667-31e51d45c085 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:34.151210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 687/1366] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:36.663600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132eda3-6e83-4a21-994a-5e3640c67226 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:36.664188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132eda3-6e83-4a21-994a-5e3640c67226 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:36.664275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132eda3-6e83-4a21-994a-5e3640c67226 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:36.665651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 680/1367] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:36.671849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4e70-429c-487e-bf96-98d5fa2e2b0b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:36.672373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4e70-429c-487e-bf96-98d5fa2e2b0b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:36.672373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4e70-429c-487e-bf96-98d5fa2e2b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:36.691507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a41d4e70-429c-487e-bf96-98d5fa2e2b0b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:36.692706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a41d4e70-429c-487e-bf96-98d5fa2e2b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:36.701294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 688/1368] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:36.745305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132eda3-6e83-4a21-994a-5e3640c67226 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:36.755999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb255fd0-3912-4503-98ea-1ad63db75c3d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:36.756496 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb255fd0-3912-4503-98ea-1ad63db75c3d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:36.756620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb255fd0-3912-4503-98ea-1ad63db75c3d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:36.758182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 689/1369] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:05:36.763989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132eda3-6e83-4a21-994a-5e3640c67226 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:36.764711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4a2a-1830-451a-a947-cab74203dab9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:36.765284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4a2a-1830-451a-a947-cab74203dab9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:36.765769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4a2a-1830-451a-a947-cab74203dab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:36.769923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74cec1-dfff-40aa-994f-086c48d5016e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:36.770565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74cec1-dfff-40aa-994f-086c48d5016e service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:36.770842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74cec1-dfff-40aa-994f-086c48d5016e service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:36.771140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74cec1-dfff-40aa-994f-086c48d5016e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:36.779778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74cec1-dfff-40aa-994f-086c48d5016e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:36.781939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74cec1-dfff-40aa-994f-086c48d5016e service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:36.786009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b36b4a2a-1830-451a-a947-cab74203dab9 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:36.787411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b36b4a2a-1830-451a-a947-cab74203dab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:36.792649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 681/1370] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:36.796120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 690/1371] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:37.068804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e583-3652-446c-8a72-430791ce6980 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:37.069599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e583-3652-446c-8a72-430791ce6980 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:37.069890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e583-3652-446c-8a72-430791ce6980 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:37.071737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 682/1372] 10.222.0.13 () {54 vars in 963 bytes} [Thu Jun 2 10:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:37.077374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e07d0-f86f-44ff-82c9-e0f606a77ab9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:37.077691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e07d0-f86f-44ff-82c9-e0f606a77ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:37.077932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e07d0-f86f-44ff-82c9-e0f606a77ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:37.134100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c95e07d0-f86f-44ff-82c9-e0f606a77ab9 None None] MFA Rules not processed for user `a75463d1b7714510b3898b7fe05baf50`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:37.135433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c95e07d0-f86f-44ff-82c9-e0f606a77ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:37.201115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 691/1373] 10.222.0.13 () {58 vars in 1060 bytes} [Thu Jun 2 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:37.208609 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e583-3652-446c-8a72-430791ce6980 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:37.219660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e583-3652-446c-8a72-430791ce6980 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:37.223221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfbe03-f358-4872-968e-a356ad1c9eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:37.223888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfbe03-f358-4872-968e-a356ad1c9eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:37.224167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfbe03-f358-4872-968e-a356ad1c9eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:37.224442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfbe03-f358-4872-968e-a356ad1c9eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:37.234454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfbe03-f358-4872-968e-a356ad1c9eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:37.235887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfbe03-f358-4872-968e-a356ad1c9eb4 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:37.239815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:37.247293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 683/1374] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:39.179506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468d2db-6cc7-45c7-b84c-ce6542dd0232 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:39.180034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468d2db-6cc7-45c7-b84c-ce6542dd0232 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:39.180034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468d2db-6cc7-45c7-b84c-ce6542dd0232 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:39.181380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 692/1375] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:39.187965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cae979-3795-411e-a111-e21587dd029f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:39.188504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cae979-3795-411e-a111-e21587dd029f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:39.188504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cae979-3795-411e-a111-e21587dd029f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:39.207662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-77cae979-3795-411e-a111-e21587dd029f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:39.208883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-77cae979-3795-411e-a111-e21587dd029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:39.216784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 684/1376] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:39.265870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468d2db-6cc7-45c7-b84c-ce6542dd0232 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:39.281352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468d2db-6cc7-45c7-b84c-ce6542dd0232 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:39.286912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a27e16-fed4-464a-81e3-cdd11e6e6695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:39.287613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27e16-fed4-464a-81e3-cdd11e6e6695 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:39.287900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27e16-fed4-464a-81e3-cdd11e6e6695 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:39.288181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27e16-fed4-464a-81e3-cdd11e6e6695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:39.298208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a27e16-fed4-464a-81e3-cdd11e6e6695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:39.299875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a27e16-fed4-464a-81e3-cdd11e6e6695 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:39.311117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 693/1377] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:41.807972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5b463-5cfc-4a91-ad2d-325790754e0e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:41.808516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5b463-5cfc-4a91-ad2d-325790754e0e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:41.808516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5b463-5cfc-4a91-ad2d-325790754e0e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:41.809874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 685/1378] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:41.815168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc911c-7a70-4a41-9c6f-163a644031d9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:41.815570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc911c-7a70-4a41-9c6f-163a644031d9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:41.815734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc911c-7a70-4a41-9c6f-163a644031d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:41.834171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-46dc911c-7a70-4a41-9c6f-163a644031d9 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:41.835397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-46dc911c-7a70-4a41-9c6f-163a644031d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:41.843499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 694/1379] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:41.888356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5b463-5cfc-4a91-ad2d-325790754e0e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:41.902668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5b463-5cfc-4a91-ad2d-325790754e0e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:41.908130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d42e4-7174-49bb-825e-7e5caa22decc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:41.908763 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d42e4-7174-49bb-825e-7e5caa22decc service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:41.909069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d42e4-7174-49bb-825e-7e5caa22decc service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:41.909340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d42e4-7174-49bb-825e-7e5caa22decc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:41.917590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d42e4-7174-49bb-825e-7e5caa22decc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:41.919166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d42e4-7174-49bb-825e-7e5caa22decc service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:41.928782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 686/1380] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:44.336967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3f8ed-f384-4ea1-b028-2ae1bcc01409 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:44.338470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3f8ed-f384-4ea1-b028-2ae1bcc01409 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:44.338754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3f8ed-f384-4ea1-b028-2ae1bcc01409 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:44.340173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 695/1381] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:44.345528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31c712-1725-4b57-9f6c-85d346e4a327 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:44.345937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31c712-1725-4b57-9f6c-85d346e4a327 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:44.346147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31c712-1725-4b57-9f6c-85d346e4a327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:44.363974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7c31c712-1725-4b57-9f6c-85d346e4a327 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:44.365172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7c31c712-1725-4b57-9f6c-85d346e4a327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:44.373598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 687/1382] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:44.416301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3f8ed-f384-4ea1-b028-2ae1bcc01409 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:44.431036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3f8ed-f384-4ea1-b028-2ae1bcc01409 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:44.436681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54520fb9-538f-406d-83a7-dce3faf453b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:44.437317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520fb9-538f-406d-83a7-dce3faf453b7 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:44.437605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520fb9-538f-406d-83a7-dce3faf453b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:44.437883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520fb9-538f-406d-83a7-dce3faf453b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:44.446538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54520fb9-538f-406d-83a7-dce3faf453b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:44.448675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54520fb9-538f-406d-83a7-dce3faf453b7 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:44.458485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 696/1383] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:46.873800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d624212-cf22-4f58-83e2-8a471c2390ec None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:46.874353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d624212-cf22-4f58-83e2-8a471c2390ec None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:46.874462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d624212-cf22-4f58-83e2-8a471c2390ec None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:46.876014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 688/1384] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:46.882177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd1f8e-af4a-4cf8-9939-9b6dfba8a32d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:46.882691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd1f8e-af4a-4cf8-9939-9b6dfba8a32d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:46.882815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd1f8e-af4a-4cf8-9939-9b6dfba8a32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:46.900931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5fbd1f8e-af4a-4cf8-9939-9b6dfba8a32d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:46.902127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5fbd1f8e-af4a-4cf8-9939-9b6dfba8a32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:46.909959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 697/1385] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:46.954205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d624212-cf22-4f58-83e2-8a471c2390ec None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:46.975638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d624212-cf22-4f58-83e2-8a471c2390ec None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:46.984646 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd2a67-26ea-43d7-afbd-35e1caa8b35d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:46.985614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd2a67-26ea-43d7-afbd-35e1caa8b35d service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:46.986017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd2a67-26ea-43d7-afbd-35e1caa8b35d service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:46.986400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd2a67-26ea-43d7-afbd-35e1caa8b35d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:46.999755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd2a67-26ea-43d7-afbd-35e1caa8b35d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:47.002261 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd2a67-26ea-43d7-afbd-35e1caa8b35d service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:47.016979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 689/1386] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:49.406593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4b55-d698-4d29-962d-42eb7827aec8 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:49.407173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4b55-d698-4d29-962d-42eb7827aec8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:49.407173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4b55-d698-4d29-962d-42eb7827aec8 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:49.408525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 698/1387] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:05:49.413952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d02148-9099-499c-bb87-fb1ee66d4d19 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:49.414549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d02148-9099-499c-bb87-fb1ee66d4d19 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:49.414549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d02148-9099-499c-bb87-fb1ee66d4d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:49.433989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-54d02148-9099-499c-bb87-fb1ee66d4d19 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:49.435260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-54d02148-9099-499c-bb87-fb1ee66d4d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:49.443553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 690/1388] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:49.488647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f4b55-d698-4d29-962d-42eb7827aec8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:49.504077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f4b55-d698-4d29-962d-42eb7827aec8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:49.510044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a23673-9437-48ea-ab60-1561b0c7787b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:49.510695 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a23673-9437-48ea-ab60-1561b0c7787b service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:49.510981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a23673-9437-48ea-ab60-1561b0c7787b service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:49.511287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a23673-9437-48ea-ab60-1561b0c7787b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:49.520053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a23673-9437-48ea-ab60-1561b0c7787b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:49.521617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a23673-9437-48ea-ab60-1561b0c7787b service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:49.532982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 699/1389] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:51.939065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9a13-ff60-45a0-ac4d-7bc87483f844 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:51.939733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9a13-ff60-45a0-ac4d-7bc87483f844 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:51.939733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9a13-ff60-45a0-ac4d-7bc87483f844 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:51.941007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 691/1390] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:51.947157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5989-53d7-490d-a9df-fa8dac8f0565 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:51.947614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5989-53d7-490d-a9df-fa8dac8f0565 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:51.947614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5989-53d7-490d-a9df-fa8dac8f0565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:51.965723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-70fe5989-53d7-490d-a9df-fa8dac8f0565 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:51.966917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-70fe5989-53d7-490d-a9df-fa8dac8f0565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:51.974875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 700/1391] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:52.018616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f9a13-ff60-45a0-ac4d-7bc87483f844 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:52.033432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f9a13-ff60-45a0-ac4d-7bc87483f844 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:52.038742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d711e-d249-43e5-a875-866ab68b4926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:52.039417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d711e-d249-43e5-a875-866ab68b4926 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:52.039696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d711e-d249-43e5-a875-866ab68b4926 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:52.039970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d711e-d249-43e5-a875-866ab68b4926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:52.048475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d711e-d249-43e5-a875-866ab68b4926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:52.050038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d711e-d249-43e5-a875-866ab68b4926 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:52.059537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 692/1392] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:53.811295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777acc-ac7e-4c01-8564-38d8488c03ea None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:53.811839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777acc-ac7e-4c01-8564-38d8488c03ea None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:53.811839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777acc-ac7e-4c01-8564-38d8488c03ea None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:53.813131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 701/1393] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:05:53.818442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c3ed-4e7d-41f5-8633-903696398b89 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:53.818910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c3ed-4e7d-41f5-8633-903696398b89 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:53.819026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c3ed-4e7d-41f5-8633-903696398b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:53.836439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ab93c3ed-4e7d-41f5-8633-903696398b89 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:53.838151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ab93c3ed-4e7d-41f5-8633-903696398b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:53.845960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 693/1394] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:53.902151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16844ef3-e021-463b-994b-b9b5ad47c580 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:53.902439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16844ef3-e021-463b-994b-b9b5ad47c580 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:53.902716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16844ef3-e021-463b-994b-b9b5ad47c580 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:53.904115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 702/1395] 10.222.0.13 () {54 vars in 962 bytes} [Thu Jun 2 10:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:53.908989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96709-282e-49e6-95c2-429a3fb2b971 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:53.909275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96709-282e-49e6-95c2-429a3fb2b971 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:53.909547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b96709-282e-49e6-95c2-429a3fb2b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:53.958419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a4b96709-282e-49e6-95c2-429a3fb2b971 None None] MFA Rules not processed for user `bbbc657ed3ae49dc9d45687c5dde2ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:53.959659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a4b96709-282e-49e6-95c2-429a3fb2b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:54.018600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 694/1396] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Jun 2 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:54.026598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16844ef3-e021-463b-994b-b9b5ad47c580 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:54.032034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=87 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:54.037823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16844ef3-e021-463b-994b-b9b5ad47c580 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:54.041920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb44e0-2268-40fd-926a-997cd91d1061 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbc657ed3ae49dc9d45687c5dde2ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:54.052644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb44e0-2268-40fd-926a-997cd91d1061 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:54.052644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb44e0-2268-40fd-926a-997cd91d1061 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:54.052644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb44e0-2268-40fd-926a-997cd91d1061 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:54.052644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb44e0-2268-40fd-926a-997cd91d1061 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:54.053792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb44e0-2268-40fd-926a-997cd91d1061 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:54.064145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 703/1397] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:54.424936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b675f5e-3d0e-4a93-b7e0-e3d26a723c71 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:54.425223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b675f5e-3d0e-4a93-b7e0-e3d26a723c71 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:54.425498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b675f5e-3d0e-4a93-b7e0-e3d26a723c71 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:54.426997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 695/1398] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:54.432427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8d89-c9e2-42ec-a1b0-0c08005a55a0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:54.437499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8d89-c9e2-42ec-a1b0-0c08005a55a0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:54.437499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8d89-c9e2-42ec-a1b0-0c08005a55a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:54.452487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-353a8d89-c9e2-42ec-a1b0-0c08005a55a0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:54.453698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-353a8d89-c9e2-42ec-a1b0-0c08005a55a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:54.462769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 704/1399] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:54.507670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b675f5e-3d0e-4a93-b7e0-e3d26a723c71 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:54.521866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b675f5e-3d0e-4a93-b7e0-e3d26a723c71 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:54.527742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d645ad-10a0-4ff2-8a5b-35d2fa0e301c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:54.528383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d645ad-10a0-4ff2-8a5b-35d2fa0e301c service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:54.528664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d645ad-10a0-4ff2-8a5b-35d2fa0e301c service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:54.528935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d645ad-10a0-4ff2-8a5b-35d2fa0e301c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:54.537190 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d645ad-10a0-4ff2-8a5b-35d2fa0e301c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:54.538746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d645ad-10a0-4ff2-8a5b-35d2fa0e301c service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:54.549276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 696/1400] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:54.786709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecda8b9-3ddf-4e4c-9429-64533501905e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:54.786989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecda8b9-3ddf-4e4c-9429-64533501905e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:54.787294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecda8b9-3ddf-4e4c-9429-64533501905e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:54.843325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7ecda8b9-3ddf-4e4c-9429-64533501905e None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:54.844433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7ecda8b9-3ddf-4e4c-9429-64533501905e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:54.914550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 705/1401] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:54.960115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce4210-fb5b-4842-a744-66e41b8ab2c2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:54.960596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce4210-fb5b-4842-a744-66e41b8ab2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:54.960699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce4210-fb5b-4842-a744-66e41b8ab2c2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:54.962037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 697/1402] 10.222.0.13 () {54 vars in 942 bytes} [Thu Jun 2 10:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:54.968852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38c10-4e00-476f-980b-cc31010bc5fe None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:54.969142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38c10-4e00-476f-980b-cc31010bc5fe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:54.969417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38c10-4e00-476f-980b-cc31010bc5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:55.017718 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dbf38c10-4e00-476f-980b-cc31010bc5fe None None] MFA Rules not processed for user `ffbe700a0ebc48b5953a600400ecfed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:55.018831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dbf38c10-4e00-476f-980b-cc31010bc5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:55.091991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 706/1403] 10.222.0.13 () {58 vars in 1039 bytes} [Thu Jun 2 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:55.101353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce4210-fb5b-4842-a744-66e41b8ab2c2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:55.114947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce4210-fb5b-4842-a744-66e41b8ab2c2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:55.120583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d2b30-2dfe-4994-a010-2c49e84415c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:55.121229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2b30-2dfe-4994-a010-2c49e84415c8 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:55.121507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2b30-2dfe-4994-a010-2c49e84415c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:55.121792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2b30-2dfe-4994-a010-2c49e84415c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:55.130089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d2b30-2dfe-4994-a010-2c49e84415c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:55.131707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d2b30-2dfe-4994-a010-2c49e84415c8 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:55.140376 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 698/1404] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:05:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:05:57.056734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b277e-fe9f-4fe6-80ee-d03285209a40 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:57.057271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b277e-fe9f-4fe6-80ee-d03285209a40 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:57.057534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b277e-fe9f-4fe6-80ee-d03285209a40 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:57.059125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 707/1405] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:05:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:57.065422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b930b19-dae3-4516-9ab3-5e5ee1aba2b4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:57.065872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b930b19-dae3-4516-9ab3-5e5ee1aba2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:57.066126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b930b19-dae3-4516-9ab3-5e5ee1aba2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:57.093914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6b930b19-dae3-4516-9ab3-5e5ee1aba2b4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:57.095659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6b930b19-dae3-4516-9ab3-5e5ee1aba2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:57.104349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 699/1406] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:57.156745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b277e-fe9f-4fe6-80ee-d03285209a40 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:57.174058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b277e-fe9f-4fe6-80ee-d03285209a40 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:57.188674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d152ae-8cb5-4fb5-ac99-7ccf5b7b45c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:57.189426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d152ae-8cb5-4fb5-ac99-7ccf5b7b45c9 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:57.189770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d152ae-8cb5-4fb5-ac99-7ccf5b7b45c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:57.190112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d152ae-8cb5-4fb5-ac99-7ccf5b7b45c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:57.199510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d152ae-8cb5-4fb5-ac99-7ccf5b7b45c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:57.201419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d152ae-8cb5-4fb5-ac99-7ccf5b7b45c9 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:57.212210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 708/1407] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:07.080352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:07.207053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:19.260855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1f554-da99-43f9-80da-14348a13e046 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:19.261440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1f554-da99-43f9-80da-14348a13e046 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:19.261440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1f554-da99-43f9-80da-14348a13e046 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:19.262738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 700/1408] 10.222.0.13 () {54 vars in 918 bytes} [Thu Jun 2 10:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:19.267926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6978eb-1dcd-4d6e-a206-08bbe2a2c565 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:19.268347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6978eb-1dcd-4d6e-a206-08bbe2a2c565 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:19.268482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6978eb-1dcd-4d6e-a206-08bbe2a2c565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:19.286383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fd6978eb-1dcd-4d6e-a206-08bbe2a2c565 None None] MFA Rules not processed for user `bef7eacc5dc0445fa3297db10c8b4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:19.287608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fd6978eb-1dcd-4d6e-a206-08bbe2a2c565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:19.296514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 709/1409] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jun 2 10:06:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:19.311215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5327c-f2b0-4692-ae85-23e0a1d0142c None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:19.311500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5327c-f2b0-4692-ae85-23e0a1d0142c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:19.311799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5327c-f2b0-4692-ae85-23e0a1d0142c None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:19.313142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 701/1410] 10.222.0.13 () {54 vars in 918 bytes} [Thu Jun 2 10:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:19.317580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4346a0-8e70-491f-ad84-7ea5011269a7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:19.317871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4346a0-8e70-491f-ad84-7ea5011269a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:19.318154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4346a0-8e70-491f-ad84-7ea5011269a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:19.335519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fc4346a0-8e70-491f-ad84-7ea5011269a7 None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:19.336726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fc4346a0-8e70-491f-ad84-7ea5011269a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:19.345622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 710/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Thu Jun 2 10:06:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:22.027751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6278690-acb8-426c-9edc-d431be48d68b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:22.028324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6278690-acb8-426c-9edc-d431be48d68b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:22.028324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6278690-acb8-426c-9edc-d431be48d68b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:22.029647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 702/1412] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:22.034870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34074b3d-6750-4b28-a3e8-dc0372225131 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:22.035305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34074b3d-6750-4b28-a3e8-dc0372225131 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:22.035462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34074b3d-6750-4b28-a3e8-dc0372225131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:22.052859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-34074b3d-6750-4b28-a3e8-dc0372225131 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:22.054042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-34074b3d-6750-4b28-a3e8-dc0372225131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:22.063138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 711/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:22.108031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6278690-acb8-426c-9edc-d431be48d68b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:22.123744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6278690-acb8-426c-9edc-d431be48d68b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:22.133517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869ac6b-5ccd-47b3-b5e2-741a89050630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:22.133517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869ac6b-5ccd-47b3-b5e2-741a89050630 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:22.133517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869ac6b-5ccd-47b3-b5e2-741a89050630 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:22.133517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869ac6b-5ccd-47b3-b5e2-741a89050630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:22.139534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869ac6b-5ccd-47b3-b5e2-741a89050630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:22.141092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869ac6b-5ccd-47b3-b5e2-741a89050630 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:22.150386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 703/1414] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:23.115906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882f0b1-8b8c-431e-974e-c71091154b14 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:23.116461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882f0b1-8b8c-431e-974e-c71091154b14 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:23.116461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882f0b1-8b8c-431e-974e-c71091154b14 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:23.118232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 712/1415] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:23.123079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443ef7-d003-43d7-bc8a-7686610f09bc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:23.123496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443ef7-d003-43d7-bc8a-7686610f09bc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:23.123658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443ef7-d003-43d7-bc8a-7686610f09bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:23.141762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-47443ef7-d003-43d7-bc8a-7686610f09bc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:23.142952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-47443ef7-d003-43d7-bc8a-7686610f09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:23.151285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 704/1416] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:23.312204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882f0b1-8b8c-431e-974e-c71091154b14 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:23.326714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882f0b1-8b8c-431e-974e-c71091154b14 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:23.332816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f284b-c3de-49bb-b7a2-3ac358b2ecb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:23.332816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f284b-c3de-49bb-b7a2-3ac358b2ecb9 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:23.333061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f284b-c3de-49bb-b7a2-3ac358b2ecb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:23.333341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f284b-c3de-49bb-b7a2-3ac358b2ecb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:23.341581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f284b-c3de-49bb-b7a2-3ac358b2ecb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:23.343242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f284b-c3de-49bb-b7a2-3ac358b2ecb9 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:23.352756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 713/1417] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:24.268319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc1e5f-5082-4f6f-af70-4bd1c217853a None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:24.268703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc1e5f-5082-4f6f-af70-4bd1c217853a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:24.268932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc1e5f-5082-4f6f-af70-4bd1c217853a None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:24.270339 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 705/1418] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:24.276011 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb70fde-d318-4150-b9d6-46d2df705827 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:24.276414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb70fde-d318-4150-b9d6-46d2df705827 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:24.276559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb70fde-d318-4150-b9d6-46d2df705827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:24.294827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0cb70fde-d318-4150-b9d6-46d2df705827 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:24.296079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0cb70fde-d318-4150-b9d6-46d2df705827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:24.303784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 714/1419] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:24.452591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc1e5f-5082-4f6f-af70-4bd1c217853a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:24.467416 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc1e5f-5082-4f6f-af70-4bd1c217853a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:24.472750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a5ab4-61ea-444f-a79a-f4f20afdfb3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:24.473410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a5ab4-61ea-444f-a79a-f4f20afdfb3a service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:24.473692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a5ab4-61ea-444f-a79a-f4f20afdfb3a service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:24.473966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a5ab4-61ea-444f-a79a-f4f20afdfb3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:24.482166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a5ab4-61ea-444f-a79a-f4f20afdfb3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:24.483828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a5ab4-61ea-444f-a79a-f4f20afdfb3a service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:24.493410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 706/1420] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:25.383629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99bbe8-6a37-4010-a4cb-1dc9d0e666f1 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:25.384158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99bbe8-6a37-4010-a4cb-1dc9d0e666f1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:25.384279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99bbe8-6a37-4010-a4cb-1dc9d0e666f1 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:25.385656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 715/1421] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:25.390778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6a40b-9f22-4b53-88e1-12e7567911f6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:25.394259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6a40b-9f22-4b53-88e1-12e7567911f6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:25.394259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6a40b-9f22-4b53-88e1-12e7567911f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:25.410535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7ae6a40b-9f22-4b53-88e1-12e7567911f6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:25.411858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7ae6a40b-9f22-4b53-88e1-12e7567911f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:25.420896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 707/1422] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:25.571828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99bbe8-6a37-4010-a4cb-1dc9d0e666f1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:25.586948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99bbe8-6a37-4010-a4cb-1dc9d0e666f1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:25.592436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48244-39ee-415f-be90-3ea75dec20fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:25.593107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48244-39ee-415f-be90-3ea75dec20fa service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:25.593388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48244-39ee-415f-be90-3ea75dec20fa service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:25.593666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48244-39ee-415f-be90-3ea75dec20fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:25.604571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf48244-39ee-415f-be90-3ea75dec20fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:25.606152 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf48244-39ee-415f-be90-3ea75dec20fa service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:25.616057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 716/1423] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:26.512172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d4a6-cbcc-47d4-923f-830c1e477cd5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:26.512709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d4a6-cbcc-47d4-923f-830c1e477cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:26.512709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d4a6-cbcc-47d4-923f-830c1e477cd5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:26.514086 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 708/1424] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:26.519134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48933d4b-6ec9-4dc3-b986-6087539d7445 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:26.519562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48933d4b-6ec9-4dc3-b986-6087539d7445 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:26.519668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48933d4b-6ec9-4dc3-b986-6087539d7445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:26.537713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-48933d4b-6ec9-4dc3-b986-6087539d7445 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:26.539552 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-48933d4b-6ec9-4dc3-b986-6087539d7445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:26.547058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 717/1425] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:26.693392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d4a6-cbcc-47d4-923f-830c1e477cd5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:26.707749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d4a6-cbcc-47d4-923f-830c1e477cd5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:26.713838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0787e-c88f-4ec2-b163-457890168379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:26.714511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0787e-c88f-4ec2-b163-457890168379 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:26.714790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0787e-c88f-4ec2-b163-457890168379 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:26.715105 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0787e-c88f-4ec2-b163-457890168379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:26.723300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0787e-c88f-4ec2-b163-457890168379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:26.724859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0787e-c88f-4ec2-b163-457890168379 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:26.734245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 709/1426] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:27.630827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7441-8b12-4cb0-b534-eb630faebfaa None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:27.631434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7441-8b12-4cb0-b534-eb630faebfaa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:27.631681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7441-8b12-4cb0-b534-eb630faebfaa None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:27.633276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 718/1427] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:27.638150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605dc1-cdbc-4f90-9fee-c773f6fc148c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:27.638581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605dc1-cdbc-4f90-9fee-c773f6fc148c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:27.638747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605dc1-cdbc-4f90-9fee-c773f6fc148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:27.656873 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b0605dc1-cdbc-4f90-9fee-c773f6fc148c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:27.658053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b0605dc1-cdbc-4f90-9fee-c773f6fc148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:27.666560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 710/1428] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:27.814996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c7441-8b12-4cb0-b534-eb630faebfaa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:27.829329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c7441-8b12-4cb0-b534-eb630faebfaa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:27.835149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed5406-1b63-4944-b654-9b6f517d27b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:27.836319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed5406-1b63-4944-b654-9b6f517d27b9 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:27.836868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed5406-1b63-4944-b654-9b6f517d27b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:27.837141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed5406-1b63-4944-b654-9b6f517d27b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:27.845560 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed5406-1b63-4944-b654-9b6f517d27b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:27.847164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed5406-1b63-4944-b654-9b6f517d27b9 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:27.857057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 719/1429] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:28.733093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54afd-99e3-402b-ad40-5318ec374c57 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:28.733722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54afd-99e3-402b-ad40-5318ec374c57 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:28.733830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54afd-99e3-402b-ad40-5318ec374c57 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:28.735383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 711/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:28.740424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67e02d-76ca-4727-ab09-9edf67633892 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:28.740816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67e02d-76ca-4727-ab09-9edf67633892 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:28.741109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67e02d-76ca-4727-ab09-9edf67633892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:28.761629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-eb67e02d-76ca-4727-ab09-9edf67633892 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:28.762827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-eb67e02d-76ca-4727-ab09-9edf67633892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:28.771168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 720/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:06:28.921171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a54afd-99e3-402b-ad40-5318ec374c57 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:28.935800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a54afd-99e3-402b-ad40-5318ec374c57 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:28.941456 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10f337-f0be-4e98-bc89-831d021ce657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:28.941645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10f337-f0be-4e98-bc89-831d021ce657 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:28.941927 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10f337-f0be-4e98-bc89-831d021ce657 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:28.942200 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10f337-f0be-4e98-bc89-831d021ce657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:28.950172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10f337-f0be-4e98-bc89-831d021ce657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:28.951757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10f337-f0be-4e98-bc89-831d021ce657 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:28.960852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 712/1432] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:29.836693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54385d96-3034-4c9e-a99d-b22af5f7aee3 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:29.837160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54385d96-3034-4c9e-a99d-b22af5f7aee3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:29.837272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54385d96-3034-4c9e-a99d-b22af5f7aee3 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:29.838632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 721/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:29.843746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb3d17-b659-4e46-bc39-7459eacf735f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:29.844181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb3d17-b659-4e46-bc39-7459eacf735f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:29.844291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb3d17-b659-4e46-bc39-7459eacf735f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:29.862121 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-13cb3d17-b659-4e46-bc39-7459eacf735f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:29.863373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-13cb3d17-b659-4e46-bc39-7459eacf735f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:29.871672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 713/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:30.022544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54385d96-3034-4c9e-a99d-b22af5f7aee3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:30.037216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54385d96-3034-4c9e-a99d-b22af5f7aee3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:30.042558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e446d-b7d1-4471-a5e0-6b2a73a3f67d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:30.043212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e446d-b7d1-4471-a5e0-6b2a73a3f67d service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:30.043493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e446d-b7d1-4471-a5e0-6b2a73a3f67d service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:30.043767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e446d-b7d1-4471-a5e0-6b2a73a3f67d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:30.051797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e446d-b7d1-4471-a5e0-6b2a73a3f67d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:30.053354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e446d-b7d1-4471-a5e0-6b2a73a3f67d service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:30.063174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 722/1435] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:30.996734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ed95b-b084-4680-bdf8-a2cc22822bc3 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:30.997193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ed95b-b084-4680-bdf8-a2cc22822bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:30.997290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ed95b-b084-4680-bdf8-a2cc22822bc3 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:30.998647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 714/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:31.003651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba2b65-7810-40d1-9c55-6514555d2f46 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:31.004074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba2b65-7810-40d1-9c55-6514555d2f46 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:31.004209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba2b65-7810-40d1-9c55-6514555d2f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:31.023346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0fba2b65-7810-40d1-9c55-6514555d2f46 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:31.024525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0fba2b65-7810-40d1-9c55-6514555d2f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:31.032454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 723/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:31.185259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ed95b-b084-4680-bdf8-a2cc22822bc3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:31.199889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ed95b-b084-4680-bdf8-a2cc22822bc3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:31.205094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a16003-5dc3-4846-a132-c36016127487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:31.205758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a16003-5dc3-4846-a132-c36016127487 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:31.206040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a16003-5dc3-4846-a132-c36016127487 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:31.206312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a16003-5dc3-4846-a132-c36016127487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:31.214418 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a16003-5dc3-4846-a132-c36016127487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:31.215999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a16003-5dc3-4846-a132-c36016127487 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:31.225479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 715/1438] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:33.290223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b46fb-ca2f-4909-b5e5-072aaafe6ee9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:33.290715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b46fb-ca2f-4909-b5e5-072aaafe6ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:33.290830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b46fb-ca2f-4909-b5e5-072aaafe6ee9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:33.292182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 724/1439] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:33.297273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13853d-76e1-4872-82c9-278dfa84a618 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:33.297670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13853d-76e1-4872-82c9-278dfa84a618 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:33.297817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13853d-76e1-4872-82c9-278dfa84a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:33.315795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6d13853d-76e1-4872-82c9-278dfa84a618 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:33.316968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6d13853d-76e1-4872-82c9-278dfa84a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:33.324589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 716/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:33.377938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda05584-e150-4a6a-b13e-c68b4807f938 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:33.378247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda05584-e150-4a6a-b13e-c68b4807f938 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:33.378521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda05584-e150-4a6a-b13e-c68b4807f938 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:33.379913 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 725/1441] 10.222.0.13 () {54 vars in 964 bytes} [Thu Jun 2 10:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:33.386346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb7bed-f18a-4591-a639-575eb348ca42 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:33.386631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb7bed-f18a-4591-a639-575eb348ca42 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:33.386904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb7bed-f18a-4591-a639-575eb348ca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:33.422116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b0cb7bed-f18a-4591-a639-575eb348ca42 None None] MFA Rules not processed for user `4bc0ef455caa4ee5b6b86dc1904d4e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:33.423334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b0cb7bed-f18a-4591-a639-575eb348ca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:33.429725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 717/1442] 10.222.0.13 () {58 vars in 1061 bytes} [Thu Jun 2 10:06:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:33.438866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda05584-e150-4a6a-b13e-c68b4807f938 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:33.450053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda05584-e150-4a6a-b13e-c68b4807f938 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:33.453585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94133-30da-40de-b2a6-ee16a9aead59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:33.455786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94133-30da-40de-b2a6-ee16a9aead59 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:33.455786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94133-30da-40de-b2a6-ee16a9aead59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:33.455786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94133-30da-40de-b2a6-ee16a9aead59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:33.464156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94133-30da-40de-b2a6-ee16a9aead59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:33.465557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94133-30da-40de-b2a6-ee16a9aead59 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:33.474936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 726/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:36.229821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9460e87-3e85-4609-8aee-5f0d6e75d506 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:36.230393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9460e87-3e85-4609-8aee-5f0d6e75d506 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:36.230393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9460e87-3e85-4609-8aee-5f0d6e75d506 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:36.231760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:36.237020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0d5ee-ff69-4696-a885-c91f4cf3b49f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:36.237438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0d5ee-ff69-4696-a885-c91f4cf3b49f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:36.237556 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0d5ee-ff69-4696-a885-c91f4cf3b49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:36.255780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-68a0d5ee-ff69-4696-a885-c91f4cf3b49f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:36.256985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68a0d5ee-ff69-4696-a885-c91f4cf3b49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:36.265686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:36.302725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9460e87-3e85-4609-8aee-5f0d6e75d506 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:36.314142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9460e87-3e85-4609-8aee-5f0d6e75d506 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:36.317676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751bb22-b659-4802-92dd-5cdfa5dcfbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:36.318314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751bb22-b659-4802-92dd-5cdfa5dcfbba service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:36.318597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751bb22-b659-4802-92dd-5cdfa5dcfbba service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:36.318873 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751bb22-b659-4802-92dd-5cdfa5dcfbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:36.328269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751bb22-b659-4802-92dd-5cdfa5dcfbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:36.329680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751bb22-b659-4802-92dd-5cdfa5dcfbba service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:36.339584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 719/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:38.981213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19e81-d1a0-4d18-af40-fcf51dcef19e None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:38.981720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19e81-d1a0-4d18-af40-fcf51dcef19e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:38.981840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19e81-d1a0-4d18-af40-fcf51dcef19e None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:38.983119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:06:38.988332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bed6c9-762d-458d-9cb0-718fa689085f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:38.988765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bed6c9-762d-458d-9cb0-718fa689085f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:38.988868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bed6c9-762d-458d-9cb0-718fa689085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:39.006727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-76bed6c9-762d-458d-9cb0-718fa689085f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:39.008443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-76bed6c9-762d-458d-9cb0-718fa689085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:39.016276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:39.055057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19e81-d1a0-4d18-af40-fcf51dcef19e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:39.065564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19e81-d1a0-4d18-af40-fcf51dcef19e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:39.069030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4cb5d-4a7b-4149-958f-4be586c333ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:39.070269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4cb5d-4a7b-4149-958f-4be586c333ea service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:39.070549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4cb5d-4a7b-4149-958f-4be586c333ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:39.070824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4cb5d-4a7b-4149-958f-4be586c333ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:39.079625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4cb5d-4a7b-4149-958f-4be586c333ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:39.081037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4cb5d-4a7b-4149-958f-4be586c333ea service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:39.090259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 729/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:41.427227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f3e56-bdda-490d-9e7a-60adac879866 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:41.427808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f3e56-bdda-490d-9e7a-60adac879866 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:41.427808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f3e56-bdda-490d-9e7a-60adac879866 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:41.429179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:41.434577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e123d3-65f6-4099-a887-31de806f2171 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:41.434986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e123d3-65f6-4099-a887-31de806f2171 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:41.435158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e123d3-65f6-4099-a887-31de806f2171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:41.452671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-08e123d3-65f6-4099-a887-31de806f2171 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:41.453843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-08e123d3-65f6-4099-a887-31de806f2171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:41.462018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:41.500254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f3e56-bdda-490d-9e7a-60adac879866 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:41.510627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f3e56-bdda-490d-9e7a-60adac879866 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:41.514028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53da4e-cdec-4e67-b592-022712496a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:41.514674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53da4e-cdec-4e67-b592-022712496a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:41.514949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53da4e-cdec-4e67-b592-022712496a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:41.515250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53da4e-cdec-4e67-b592-022712496a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:41.524490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53da4e-cdec-4e67-b592-022712496a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:41.525863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53da4e-cdec-4e67-b592-022712496a8a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:41.534987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 722/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:43.860508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75addf2e-11e5-4eac-8773-ac32e180ab25 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:43.861080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75addf2e-11e5-4eac-8773-ac32e180ab25 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:43.861080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75addf2e-11e5-4eac-8773-ac32e180ab25 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:43.862401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:43.868508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102fcf4-b778-4fe0-9b11-d46bfa9c4cf7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:43.868981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102fcf4-b778-4fe0-9b11-d46bfa9c4cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:43.869081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102fcf4-b778-4fe0-9b11-d46bfa9c4cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:43.887518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5102fcf4-b778-4fe0-9b11-d46bfa9c4cf7 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:43.888696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5102fcf4-b778-4fe0-9b11-d46bfa9c4cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:43.896567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:43.933799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75addf2e-11e5-4eac-8773-ac32e180ab25 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:43.944377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75addf2e-11e5-4eac-8773-ac32e180ab25 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:43.947888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a423c-4c0a-47f7-a135-ff0289f3adcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:43.948513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a423c-4c0a-47f7-a135-ff0289f3adcd service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:43.948792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a423c-4c0a-47f7-a135-ff0289f3adcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:43.949063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a423c-4c0a-47f7-a135-ff0289f3adcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:43.957697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a423c-4c0a-47f7-a135-ff0289f3adcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:43.959124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a423c-4c0a-47f7-a135-ff0289f3adcd service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:43.968505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 732/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:46.320311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca127-f68a-40ea-888a-c869de7cbb37 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:46.320847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca127-f68a-40ea-888a-c869de7cbb37 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:46.320847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca127-f68a-40ea-888a-c869de7cbb37 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:46.322221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:46.327503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b0f9c-f260-4c7e-9f90-72b80edb3c4a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:46.327928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b0f9c-f260-4c7e-9f90-72b80edb3c4a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:46.328064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b0f9c-f260-4c7e-9f90-72b80edb3c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:46.346209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-254b0f9c-f260-4c7e-9f90-72b80edb3c4a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:46.347438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-254b0f9c-f260-4c7e-9f90-72b80edb3c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:46.355269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:46.393795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca127-f68a-40ea-888a-c869de7cbb37 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:46.405274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca127-f68a-40ea-888a-c869de7cbb37 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:46.408781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25db85-b016-4d63-aa7a-1a1bc650b1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:46.409470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25db85-b016-4d63-aa7a-1a1bc650b1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:46.409770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25db85-b016-4d63-aa7a-1a1bc650b1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:46.410061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25db85-b016-4d63-aa7a-1a1bc650b1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:46.419222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25db85-b016-4d63-aa7a-1a1bc650b1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:46.420625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25db85-b016-4d63-aa7a-1a1bc650b1f1 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:46.429767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 725/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:48.721976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0990400-54e6-437f-a7ac-14d7da5f2810 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:48.722628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0990400-54e6-437f-a7ac-14d7da5f2810 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:48.722628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0990400-54e6-437f-a7ac-14d7da5f2810 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:48.723889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:48.729940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03201d5a-128c-4e87-819d-9fcec1ea6c21 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:48.730355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03201d5a-128c-4e87-819d-9fcec1ea6c21 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:48.730610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03201d5a-128c-4e87-819d-9fcec1ea6c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:48.736696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=79 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:48.749363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-03201d5a-128c-4e87-819d-9fcec1ea6c21 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:48.750550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-03201d5a-128c-4e87-819d-9fcec1ea6c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:48.758525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:48.797281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0990400-54e6-437f-a7ac-14d7da5f2810 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:48.802665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=73 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:48.808304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0990400-54e6-437f-a7ac-14d7da5f2810 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:48.811886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a59f2e-9cd6-408d-bcbc-f13527f18540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:48.816029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a59f2e-9cd6-408d-bcbc-f13527f18540 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:48.816029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a59f2e-9cd6-408d-bcbc-f13527f18540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:48.816029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a59f2e-9cd6-408d-bcbc-f13527f18540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:48.822156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a59f2e-9cd6-408d-bcbc-f13527f18540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:48.823629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a59f2e-9cd6-408d-bcbc-f13527f18540 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:48.833169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 735/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:51.098626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1d8d8-b8f4-4f06-98bc-90a2d33d41f6 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:51.099176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1d8d8-b8f4-4f06-98bc-90a2d33d41f6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:51.099309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1d8d8-b8f4-4f06-98bc-90a2d33d41f6 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:51.100563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:51.107480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5753a-b91f-4b2c-8026-a9968c505a86 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:51.107884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5753a-b91f-4b2c-8026-a9968c505a86 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:51.108028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5753a-b91f-4b2c-8026-a9968c505a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:51.126084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-14c5753a-b91f-4b2c-8026-a9968c505a86 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:51.127300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-14c5753a-b91f-4b2c-8026-a9968c505a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:51.135647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:51.172481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1d8d8-b8f4-4f06-98bc-90a2d33d41f6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:51.183568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1d8d8-b8f4-4f06-98bc-90a2d33d41f6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:51.187054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fd518-e357-4a68-a80e-5087cee6e6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:51.187709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fd518-e357-4a68-a80e-5087cee6e6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:51.187991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fd518-e357-4a68-a80e-5087cee6e6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:51.188263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fd518-e357-4a68-a80e-5087cee6e6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:51.197902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fd518-e357-4a68-a80e-5087cee6e6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:51.199363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fd518-e357-4a68-a80e-5087cee6e6c5 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:51.208633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 728/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:53.469121 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4f53-9d55-4ac1-8533-ba253dff6a66 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:53.469657 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4f53-9d55-4ac1-8533-ba253dff6a66 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:53.469657 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4f53-9d55-4ac1-8533-ba253dff6a66 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:53.471034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:53.477024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f61e-8056-4102-838b-5b4c0550a05c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:53.477448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f61e-8056-4102-838b-5b4c0550a05c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:53.477545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f61e-8056-4102-838b-5b4c0550a05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:53.494980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-08f2f61e-8056-4102-838b-5b4c0550a05c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:53.496169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-08f2f61e-8056-4102-838b-5b4c0550a05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:53.503677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:53.540846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e4f53-9d55-4ac1-8533-ba253dff6a66 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:53.551387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e4f53-9d55-4ac1-8533-ba253dff6a66 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:53.554940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be18f1-e276-4c47-abba-010ae228f875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:53.555595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be18f1-e276-4c47-abba-010ae228f875 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:53.555874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be18f1-e276-4c47-abba-010ae228f875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:53.556146 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be18f1-e276-4c47-abba-010ae228f875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:53.564865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be18f1-e276-4c47-abba-010ae228f875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:53.566283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be18f1-e276-4c47-abba-010ae228f875 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:53.575539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 738/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:55.796284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa75f-f6d2-4053-af4d-cf9efb699674 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:55.796859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa75f-f6d2-4053-af4d-cf9efb699674 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:55.796859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa75f-f6d2-4053-af4d-cf9efb699674 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:55.798227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:55.803734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c4d8f-a8d0-4459-8281-634d13e14ddd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:55.804660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c4d8f-a8d0-4459-8281-634d13e14ddd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:55.804840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c4d8f-a8d0-4459-8281-634d13e14ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:55.822641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-696c4d8f-a8d0-4459-8281-634d13e14ddd None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:55.823843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-696c4d8f-a8d0-4459-8281-634d13e14ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:55.831418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:55.868153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa75f-f6d2-4053-af4d-cf9efb699674 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:55.878823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa75f-f6d2-4053-af4d-cf9efb699674 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:55.882890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa0e77-2330-4deb-ba92-a9491df87908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:55.883589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa0e77-2330-4deb-ba92-a9491df87908 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:55.883870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa0e77-2330-4deb-ba92-a9491df87908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:55.884139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa0e77-2330-4deb-ba92-a9491df87908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:55.892925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa0e77-2330-4deb-ba92-a9491df87908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:55.894330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa0e77-2330-4deb-ba92-a9491df87908 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:55.903589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 731/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:05.817020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=17 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:07:05.899439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=17 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:07:27.631815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42bdc-ad41-480e-9ee3-d0a19857309a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:27.632419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42bdc-ad41-480e-9ee3-d0a19857309a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:27.632419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42bdc-ad41-480e-9ee3-d0a19857309a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:27.634256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 740/1471] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:27.639545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84638d-e5fa-46cb-8a80-88db579576a2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:27.639982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84638d-e5fa-46cb-8a80-88db579576a2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:27.640083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84638d-e5fa-46cb-8a80-88db579576a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:27.658152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fa84638d-e5fa-46cb-8a80-88db579576a2 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:27.659367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa84638d-e5fa-46cb-8a80-88db579576a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:27.667015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 732/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:27.713872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063ba29-7a81-49e8-bbc0-6dae60925ce5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:27.714159 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063ba29-7a81-49e8-bbc0-6dae60925ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:27.714434 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063ba29-7a81-49e8-bbc0-6dae60925ce5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:27.715805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 741/1473] 10.222.0.13 () {54 vars in 962 bytes} [Thu Jun 2 10:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:07:27.720612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf273f-7ec6-4516-8521-342aaf9313e2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:27.720904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf273f-7ec6-4516-8521-342aaf9313e2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:27.721183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf273f-7ec6-4516-8521-342aaf9313e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:27.738853 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2dcf273f-7ec6-4516-8521-342aaf9313e2 None None] MFA Rules not processed for user `bbbc657ed3ae49dc9d45687c5dde2ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:27.740088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2dcf273f-7ec6-4516-8521-342aaf9313e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:27.746712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 733/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Thu Jun 2 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:07:27.753876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063ba29-7a81-49e8-bbc0-6dae60925ce5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:27.764763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063ba29-7a81-49e8-bbc0-6dae60925ce5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:27.768181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0002-531a-4ab5-a5b8-329725957b1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbc657ed3ae49dc9d45687c5dde2ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:27.768791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0002-531a-4ab5-a5b8-329725957b1a service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:27.769071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0002-531a-4ab5-a5b8-329725957b1a service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:27.769343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0002-531a-4ab5-a5b8-329725957b1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:27.778656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b0002-531a-4ab5-a5b8-329725957b1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:27.780094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b0002-531a-4ab5-a5b8-329725957b1a service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:27.789339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 742/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:07:30.134291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87433a0-2ea5-4813-bc62-6dda847d73e6 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:30.134878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87433a0-2ea5-4813-bc62-6dda847d73e6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:30.134878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87433a0-2ea5-4813-bc62-6dda847d73e6 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:30.136293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 734/1476] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:30.141447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517ab7-c99b-4488-887d-82c4caffcd50 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:30.141885 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517ab7-c99b-4488-887d-82c4caffcd50 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:30.141992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517ab7-c99b-4488-887d-82c4caffcd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:30.159916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9c517ab7-c99b-4488-887d-82c4caffcd50 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:30.161100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c517ab7-c99b-4488-887d-82c4caffcd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:30.169500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 743/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:30.193748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87433a0-2ea5-4813-bc62-6dda847d73e6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:30.207010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87433a0-2ea5-4813-bc62-6dda847d73e6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:30.212201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e51db-3d2f-4473-adef-8772ccbd2320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:30.215357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e51db-3d2f-4473-adef-8772ccbd2320 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:30.215357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e51db-3d2f-4473-adef-8772ccbd2320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:30.215357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e51db-3d2f-4473-adef-8772ccbd2320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:30.215357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e51db-3d2f-4473-adef-8772ccbd2320 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:30.215907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-cc3e51db-3d2f-4473-adef-8772ccbd2320 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:07:30.215907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jun 02 10:07:30.215907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: Jun 02 10:07:30.217119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e51db-3d2f-4473-adef-8772ccbd2320 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:30.236728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 735/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Thu Jun 2 10:07:30 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:07:32.474433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06115399-586d-43f0-a1d9-112a296d9dd2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:32.475007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06115399-586d-43f0-a1d9-112a296d9dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:32.475007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06115399-586d-43f0-a1d9-112a296d9dd2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:32.476395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 744/1479] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:32.481729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a10a28-cfce-4bed-b6dd-8dbd667cb654 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:32.482198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a10a28-cfce-4bed-b6dd-8dbd667cb654 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:32.482308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a10a28-cfce-4bed-b6dd-8dbd667cb654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:32.501136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-77a10a28-cfce-4bed-b6dd-8dbd667cb654 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:32.502283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-77a10a28-cfce-4bed-b6dd-8dbd667cb654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:32.511025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 736/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:32.554757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06115399-586d-43f0-a1d9-112a296d9dd2 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:32.569668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06115399-586d-43f0-a1d9-112a296d9dd2 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:32.575679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebca0fb-054c-4c85-865a-4b37982e526b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:32.576309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebca0fb-054c-4c85-865a-4b37982e526b service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:32.576591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebca0fb-054c-4c85-865a-4b37982e526b service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:32.576866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebca0fb-054c-4c85-865a-4b37982e526b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:32.585276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebca0fb-054c-4c85-865a-4b37982e526b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:32.588685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebca0fb-054c-4c85-865a-4b37982e526b service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:32.596533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 745/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:34.978769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42480b86-7c19-41c4-a473-121c6b365de2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:34.979202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42480b86-7c19-41c4-a473-121c6b365de2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:34.979400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42480b86-7c19-41c4-a473-121c6b365de2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:34.980708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 737/1482] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:34.986014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5991c-0af0-4da8-962d-b1dd1f9c7aeb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:34.986411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5991c-0af0-4da8-962d-b1dd1f9c7aeb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:34.986559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5991c-0af0-4da8-962d-b1dd1f9c7aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:35.004723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ece5991c-0af0-4da8-962d-b1dd1f9c7aeb None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:35.005903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ece5991c-0af0-4da8-962d-b1dd1f9c7aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:35.013738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 746/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:35.049287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42480b86-7c19-41c4-a473-121c6b365de2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:35.060664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42480b86-7c19-41c4-a473-121c6b365de2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:35.064130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a55dd8-0aba-4edd-8fa8-ddba3edc4754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:35.064786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55dd8-0aba-4edd-8fa8-ddba3edc4754 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:35.065064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55dd8-0aba-4edd-8fa8-ddba3edc4754 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:35.065335 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55dd8-0aba-4edd-8fa8-ddba3edc4754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:35.074188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a55dd8-0aba-4edd-8fa8-ddba3edc4754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:35.075623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a55dd8-0aba-4edd-8fa8-ddba3edc4754 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:35.084687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 738/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:37.366369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c019992-7506-4ecd-81f7-ec9caa5c292a None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:37.366929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c019992-7506-4ecd-81f7-ec9caa5c292a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:37.366929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c019992-7506-4ecd-81f7-ec9caa5c292a None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:37.369163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 747/1485] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:37.374720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ad58-ff66-470d-b052-98745d32af68 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:37.375252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ad58-ff66-470d-b052-98745d32af68 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:37.375380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ad58-ff66-470d-b052-98745d32af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:37.393252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-22c1ad58-ff66-470d-b052-98745d32af68 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:37.394515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-22c1ad58-ff66-470d-b052-98745d32af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:37.402800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 739/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:37.441931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c019992-7506-4ecd-81f7-ec9caa5c292a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:37.453383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c019992-7506-4ecd-81f7-ec9caa5c292a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:37.456940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dae4b-db09-4a22-be98-94f321fea78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:37.457596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dae4b-db09-4a22-be98-94f321fea78c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:37.457877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dae4b-db09-4a22-be98-94f321fea78c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:37.458153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dae4b-db09-4a22-be98-94f321fea78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:37.468247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dae4b-db09-4a22-be98-94f321fea78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:37.469696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dae4b-db09-4a22-be98-94f321fea78c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:37.481130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 748/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:39.846843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae5e65-d9c5-4872-8d0a-3547a1cc47be None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:39.847435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae5e65-d9c5-4872-8d0a-3547a1cc47be None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:39.847435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae5e65-d9c5-4872-8d0a-3547a1cc47be None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:39.848788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 740/1488] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:39.854575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f52a4-f72d-4fd0-8bd4-8f999b90cd25 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:39.855009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f52a4-f72d-4fd0-8bd4-8f999b90cd25 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:39.855155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f52a4-f72d-4fd0-8bd4-8f999b90cd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:39.873045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1d0f52a4-f72d-4fd0-8bd4-8f999b90cd25 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:39.874216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1d0f52a4-f72d-4fd0-8bd4-8f999b90cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:39.881819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 749/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:39.921833 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae5e65-d9c5-4872-8d0a-3547a1cc47be None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:39.932429 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae5e65-d9c5-4872-8d0a-3547a1cc47be None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:39.935927 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f918d13-78f1-445c-bf20-e1ae2915b7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:39.936552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918d13-78f1-445c-bf20-e1ae2915b7ac service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:39.936832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918d13-78f1-445c-bf20-e1ae2915b7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:39.937106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918d13-78f1-445c-bf20-e1ae2915b7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:39.945746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918d13-78f1-445c-bf20-e1ae2915b7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:39.947194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918d13-78f1-445c-bf20-e1ae2915b7ac service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:39.956396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 741/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:42.591525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509cbfd-a643-4148-b2df-481fb098951d None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:42.592132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509cbfd-a643-4148-b2df-481fb098951d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:42.592132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509cbfd-a643-4148-b2df-481fb098951d None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:42.593446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 750/1491] 10.222.0.13 () {54 vars in 926 bytes} [Thu Jun 2 10:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:42.598883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191708ea-d04d-4b39-b249-2ac16211caa2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:42.599355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191708ea-d04d-4b39-b249-2ac16211caa2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:42.599466 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191708ea-d04d-4b39-b249-2ac16211caa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:42.617087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-191708ea-d04d-4b39-b249-2ac16211caa2 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:42.618866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-191708ea-d04d-4b39-b249-2ac16211caa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:42.626670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 742/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:42.665460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509cbfd-a643-4148-b2df-481fb098951d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:42.676232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509cbfd-a643-4148-b2df-481fb098951d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:42.679717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503f03d-1702-474f-9402-5d8e6dd8039d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:42.680939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f03d-1702-474f-9402-5d8e6dd8039d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:42.681220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f03d-1702-474f-9402-5d8e6dd8039d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:42.681496 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f03d-1702-474f-9402-5d8e6dd8039d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:42.690332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503f03d-1702-474f-9402-5d8e6dd8039d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:42.691778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503f03d-1702-474f-9402-5d8e6dd8039d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:42.701034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 751/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:52.612091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=33 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:07:52.696940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=33 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:09:16.264199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc7a3-497a-4de0-9be2-d864e1c576a5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:16.264793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc7a3-497a-4de0-9be2-d864e1c576a5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:16.264793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc7a3-497a-4de0-9be2-d864e1c576a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:16.284064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a7dfc7a3-497a-4de0-9be2-d864e1c576a5 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:09:16.285237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a7dfc7a3-497a-4de0-9be2-d864e1c576a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:09:16.292854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 743/1494] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:09:16.300738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5803-bfa3-4505-8eb4-651ff94523a0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:16.301227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5803-bfa3-4505-8eb4-651ff94523a0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:16.301348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5803-bfa3-4505-8eb4-651ff94523a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:16.318752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-78dc5803-bfa3-4505-8eb4-651ff94523a0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:09:16.319957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-78dc5803-bfa3-4505-8eb4-651ff94523a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:09:16.328066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 752/1495] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:09:16.332350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc7a3-497a-4de0-9be2-d864e1c576a5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:16.342399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc7a3-497a-4de0-9be2-d864e1c576a5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:16.346879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:16.347554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:16.347834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:16.348110 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:16.348822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:09:16.349129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:16.350114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:09:16.350114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jun 02 10:09:16.350114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: Jun 02 10:09:16.350982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:16.362218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 744/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:09:16.370128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc5803-bfa3-4505-8eb4-651ff94523a0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:16.379485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc5803-bfa3-4505-8eb4-651ff94523a0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:16.383950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f98395-0cd3-4c3b-b2e9-63037da2ad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:16.384590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f98395-0cd3-4c3b-b2e9-63037da2ad40 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:16.384873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f98395-0cd3-4c3b-b2e9-63037da2ad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:16.385149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f98395-0cd3-4c3b-b2e9-63037da2ad40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:16.385839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f98395-0cd3-4c3b-b2e9-63037da2ad40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:16.388084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-89f98395-0cd3-4c3b-b2e9-63037da2ad40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:09:16.388084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jun 02 10:09:16.388084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: Jun 02 10:09:16.389262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f98395-0cd3-4c3b-b2e9-63037da2ad40 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:16.486562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 753/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:09:16 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:09:16.490511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:16.501060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d425fc-0e3d-4a73-a5fd-dd35d1969ac9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:16.555567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d83d49-ad12-4461-9a96-cbdabbd202e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:16.556227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d83d49-ad12-4461-9a96-cbdabbd202e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:16.556504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d83d49-ad12-4461-9a96-cbdabbd202e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:16.556773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d83d49-ad12-4461-9a96-cbdabbd202e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:16.557449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d83d49-ad12-4461-9a96-cbdabbd202e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:16.558475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-e9d83d49-ad12-4461-9a96-cbdabbd202e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:09:16.558475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jun 02 10:09:16.558475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: Jun 02 10:09:16.560177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d83d49-ad12-4461-9a96-cbdabbd202e1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:16.667678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 745/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:09:16 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:09:16.671948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f98395-0cd3-4c3b-b2e9-63037da2ad40 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:16.682255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f98395-0cd3-4c3b-b2e9-63037da2ad40 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:16.687362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce33b6-ef49-4ae0-9a80-bd083da95ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:16.688014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce33b6-ef49-4ae0-9a80-bd083da95ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:16.688298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce33b6-ef49-4ae0-9a80-bd083da95ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:16.688572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce33b6-ef49-4ae0-9a80-bd083da95ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:16.689286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce33b6-ef49-4ae0-9a80-bd083da95ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:16.690338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-bcce33b6-ef49-4ae0-9a80-bd083da95ce1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:09:16.690338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jun 02 10:09:16.690338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: Jun 02 10:09:16.691247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce33b6-ef49-4ae0-9a80-bd083da95ce1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:16.704446 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 754/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:09:16.708449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d83d49-ad12-4461-9a96-cbdabbd202e1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:16.718492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d83d49-ad12-4461-9a96-cbdabbd202e1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:16.723202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a96d-a6f4-4cbc-b310-68829884ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:16.723863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a96d-a6f4-4cbc-b310-68829884ab4c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:16.724146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a96d-a6f4-4cbc-b310-68829884ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:16.724420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a96d-a6f4-4cbc-b310-68829884ab4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:16.725148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a96d-a6f4-4cbc-b310-68829884ab4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:16.726140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-c626a96d-a6f4-4cbc-b310-68829884ab4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:09:16.726140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jun 02 10:09:16.726140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: Jun 02 10:09:16.727112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a96d-a6f4-4cbc-b310-68829884ab4c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:16.740546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 746/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:09:16.744470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce33b6-ef49-4ae0-9a80-bd083da95ce1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:16.754693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce33b6-ef49-4ae0-9a80-bd083da95ce1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:16.759289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5068d-6d0a-4a3c-ab54-8295461fa7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:16.760154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5068d-6d0a-4a3c-ab54-8295461fa7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:16.760436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5068d-6d0a-4a3c-ab54-8295461fa7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:16.760710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5068d-6d0a-4a3c-ab54-8295461fa7b3 admin admin] PATH_INFO: `/v3/projects/ed4d3a0653b4479f82502adb6c28a929/users/f7592312e92e43a88e62ee5ad92ee2c9/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:16.775867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5068d-6d0a-4a3c-ab54-8295461fa7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4d3a0653b4479f82502adb6c28a929, user_id=f7592312e92e43a88e62ee5ad92ee2c9, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:16.776889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-81d5068d-6d0a-4a3c-ab54-8295461fa7b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:09:16.776889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jun 02 10:09:16.776889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: Jun 02 10:09:16.778860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5068d-6d0a-4a3c-ab54-8295461fa7b3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:16.878972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 755/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:09:16 2022] PUT /identity/v3/projects/ed4d3a0653b4479f82502adb6c28a929/users/f7592312e92e43a88e62ee5ad92ee2c9/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:09:16.900290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c962-c12f-41fc-8a28-4e64257ed9fb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:16.900580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c962-c12f-41fc-8a28-4e64257ed9fb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:16.900857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c962-c12f-41fc-8a28-4e64257ed9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:16.926473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-83e0c962-c12f-41fc-8a28-4e64257ed9fb None None] MFA Rules not processed for user `f7592312e92e43a88e62ee5ad92ee2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:09:16.927776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-83e0c962-c12f-41fc-8a28-4e64257ed9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:09:16.989296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 747/1502] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:09:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:09:17.003118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d074ab-75d8-45a2-924c-b39e7c7e807b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:17.003420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d074ab-75d8-45a2-924c-b39e7c7e807b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:17.003701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d074ab-75d8-45a2-924c-b39e7c7e807b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:17.005048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 756/1503] 10.222.0.13 () {54 vars in 963 bytes} [Thu Jun 2 10:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:09:17.009612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac940e-3bbc-4c66-907b-48b9370553be None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:17.009898 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac940e-3bbc-4c66-907b-48b9370553be None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:17.010174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac940e-3bbc-4c66-907b-48b9370553be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:17.027662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-63ac940e-3bbc-4c66-907b-48b9370553be None None] MFA Rules not processed for user `a75463d1b7714510b3898b7fe05baf50`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:09:17.028846 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-63ac940e-3bbc-4c66-907b-48b9370553be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:09:17.072618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:09:17.080017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 748/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Thu Jun 2 10:09:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:09:17.087948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d074ab-75d8-45a2-924c-b39e7c7e807b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:17.099993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d074ab-75d8-45a2-924c-b39e7c7e807b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:17.103516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5eebf-365a-4564-95be-16c69015cc31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:17.107875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5eebf-365a-4564-95be-16c69015cc31 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:17.107875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5eebf-365a-4564-95be-16c69015cc31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:17.107875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5eebf-365a-4564-95be-16c69015cc31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:17.113396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5eebf-365a-4564-95be-16c69015cc31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:17.114803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5eebf-365a-4564-95be-16c69015cc31 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:17.124661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 757/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:09:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:09:17.164904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197a5cf-970c-4e28-aa75-55f117525a46 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:17.165196 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197a5cf-970c-4e28-aa75-55f117525a46 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:17.165476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197a5cf-970c-4e28-aa75-55f117525a46 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:17.166756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 749/1506] 10.222.0.13 () {52 vars in 829 bytes} [Thu Jun 2 10:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:09:17.170951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5eebf-365a-4564-95be-16c69015cc31 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:17.233222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5eebf-365a-4564-95be-16c69015cc31 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:17.237737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:17.238594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:17.238875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:17.239182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] PATH_INFO: `/v3/users/f7592312e92e43a88e62ee5ad92ee2c9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:17.240357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7592312e92e43a88e62ee5ad92ee2c9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:17.241364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:09:17.241364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jun 02 10:09:17.241364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: Jun 02 10:09:17.242555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:17.738195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7592312e92e43a88e62ee5ad92ee2c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:17.738972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7592312e92e43a88e62ee5ad92ee2c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:17.756967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7592312e92e43a88e62ee5ad92ee2c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:17.769376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7592312e92e43a88e62ee5ad92ee2c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:17.770170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7592312e92e43a88e62ee5ad92ee2c9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:17.774074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:09:17.856397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 758/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:09:17 2022] DELETE /identity/v3/users/f7592312e92e43a88e62ee5ad92ee2c9 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:09:17.860881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23c63f-d908-4788-a80d-2c2a3ceb4ef5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:17.861372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23c63f-d908-4788-a80d-2c2a3ceb4ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:17.861489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23c63f-d908-4788-a80d-2c2a3ceb4ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:17.878916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2b23c63f-d908-4788-a80d-2c2a3ceb4ef5 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:09:17.880159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2b23c63f-d908-4788-a80d-2c2a3ceb4ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:09:17.938079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 750/1508] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:09:17.947485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:17.948904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:09:18.004693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fde54-0915-40ac-b2c2-d4e116b24062 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:18.008200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b16007-73a2-4b6e-8dce-9c97b35d5ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:18.008834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b16007-73a2-4b6e-8dce-9c97b35d5ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:18.009117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b16007-73a2-4b6e-8dce-9c97b35d5ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:18.009392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b16007-73a2-4b6e-8dce-9c97b35d5ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:18.019076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b16007-73a2-4b6e-8dce-9c97b35d5ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:18.020516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b16007-73a2-4b6e-8dce-9c97b35d5ec6 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:18.029837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 759/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:09:18.560160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23c63f-d908-4788-a80d-2c2a3ceb4ef5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:09:18.562447 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2b23c63f-d908-4788-a80d-2c2a3ceb4ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:09:18.573899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23c63f-d908-4788-a80d-2c2a3ceb4ef5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:09:18.579182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:09:18.580196 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:09:18.580473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:09:18.580743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] PATH_INFO: `/v3/projects/ed4d3a0653b4479f82502adb6c28a929` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:09:18.581918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4d3a0653b4479f82502adb6c28a929)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:09:18.582916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:09:18.582916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jun 02 10:09:18.582916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: Jun 02 10:09:18.584122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:09:18.724818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4d3a0653b4479f82502adb6c28a929', 'request_id': 'req-708f01d5-fa29-49bc-86c9-8a3a991ab672'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:18.740011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4d3a0653b4479f82502adb6c28a929', 'request_id': 'req-708f01d5-fa29-49bc-86c9-8a3a991ab672'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:18.850867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4d3a0653b4479f82502adb6c28a929', 'request_id': 'req-708f01d5-fa29-49bc-86c9-8a3a991ab672'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:18.862773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] The token cache is being invalidate because project ed4d3a0653b4479f82502adb6c28a929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:09:18.863391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:18.863685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-708f01d5-fa29-49bc-86c9-8a3a991ab672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:09:18.865344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 751/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:09:18 2022] DELETE /identity/v3/projects/ed4d3a0653b4479f82502adb6c28a929 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:09:28.025692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:09:28.859670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:10:55.832015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1358a0-5591-4109-84cd-acaa6288de4b None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:55.832628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1358a0-5591-4109-84cd-acaa6288de4b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:55.832628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1358a0-5591-4109-84cd-acaa6288de4b None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:55.833910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:10:55.838937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4084f-b9ef-4a76-a4e6-b57d444cd709 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:55.839418 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4084f-b9ef-4a76-a4e6-b57d444cd709 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:55.839528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4084f-b9ef-4a76-a4e6-b57d444cd709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:55.858179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0db4084f-b9ef-4a76-a4e6-b57d444cd709 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:55.859425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0db4084f-b9ef-4a76-a4e6-b57d444cd709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:55.919231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:10:56.089090 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1358a0-5591-4109-84cd-acaa6288de4b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:10:56.091542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fa1358a0-5591-4109-84cd-acaa6288de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:56.165923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1358a0-5591-4109-84cd-acaa6288de4b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:10:56.171373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bd0f7-8343-4c26-aa96-c532be6e29a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:10:56.172010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bd0f7-8343-4c26-aa96-c532be6e29a2 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:56.172301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bd0f7-8343-4c26-aa96-c532be6e29a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:56.172576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bd0f7-8343-4c26-aa96-c532be6e29a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:56.180584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bd0f7-8343-4c26-aa96-c532be6e29a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:10:56.182176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bd0f7-8343-4c26-aa96-c532be6e29a2 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:10:56.191888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 761/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:10:57.058786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f88214-3128-40e0-996b-f70e30ddfa78 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:57.059417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f88214-3128-40e0-996b-f70e30ddfa78 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:57.059417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f88214-3128-40e0-996b-f70e30ddfa78 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:57.060833 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:10:57.065723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247d94-3bf6-456f-ba7b-a2ee64ba09ed None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:57.066168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247d94-3bf6-456f-ba7b-a2ee64ba09ed None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:57.066396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247d94-3bf6-456f-ba7b-a2ee64ba09ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:57.084202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-45247d94-3bf6-456f-ba7b-a2ee64ba09ed None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:57.085500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-45247d94-3bf6-456f-ba7b-a2ee64ba09ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:57.094120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:10:57.136395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f897-6d3c-408b-8a9c-3ee68573bfa4 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:57.136775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f897-6d3c-408b-8a9c-3ee68573bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:57.137116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f897-6d3c-408b-8a9c-3ee68573bfa4 None None] PATH_INFO: `/v3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:57.138485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 754/1516] 10.222.0.17 () {54 vars in 925 bytes} [Thu Jun 2 10:10:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:10:57.144343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17321e-54fb-4db6-8f9e-8985fcdd739c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:57.144692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17321e-54fb-4db6-8f9e-8985fcdd739c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:57.145035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17321e-54fb-4db6-8f9e-8985fcdd739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:57.163320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1a17321e-54fb-4db6-8f9e-8985fcdd739c None None] MFA Rules not processed for user `bef7eacc5dc0445fa3297db10c8b4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:57.164495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1a17321e-54fb-4db6-8f9e-8985fcdd739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:57.226660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 763/1517] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Jun 2 10:10:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:10:57.246078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f897-6d3c-408b-8a9c-3ee68573bfa4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:10:57.260293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f897-6d3c-408b-8a9c-3ee68573bfa4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:10:57.265840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff1b1d-3c4a-4422-9747-07dd444088d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:10:57.266550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff1b1d-3c4a-4422-9747-07dd444088d0 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:57.266856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff1b1d-3c4a-4422-9747-07dd444088d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:57.267157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff1b1d-3c4a-4422-9747-07dd444088d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:57.275483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff1b1d-3c4a-4422-9747-07dd444088d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:10:57.277026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff1b1d-3c4a-4422-9747-07dd444088d0 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:10:57.286746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 755/1518] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:01.354619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63659dbf-11f5-46f6-8961-50f80d01a501 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:01.355171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63659dbf-11f5-46f6-8961-50f80d01a501 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:01.355802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63659dbf-11f5-46f6-8961-50f80d01a501 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:01.357055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 764/1519] 10.222.0.13 () {54 vars in 960 bytes} [Thu Jun 2 10:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:11:01.362283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b17862-5402-4a02-a7c2-a9976ab919d5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:01.362731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b17862-5402-4a02-a7c2-a9976ab919d5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:01.362844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b17862-5402-4a02-a7c2-a9976ab919d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:01.381493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e7b17862-5402-4a02-a7c2-a9976ab919d5 None None] MFA Rules not processed for user `bef7eacc5dc0445fa3297db10c8b4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:11:01.382673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e7b17862-5402-4a02-a7c2-a9976ab919d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:01.390915 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 756/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Thu Jun 2 10:11:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:11:01.398292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63659dbf-11f5-46f6-8961-50f80d01a501 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:11:01.411377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63659dbf-11f5-46f6-8961-50f80d01a501 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:11:01.416165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949fa10-c35a-447a-9b65-876987d4b318 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:11:01.416780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949fa10-c35a-447a-9b65-876987d4b318 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:01.417059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949fa10-c35a-447a-9b65-876987d4b318 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:01.417329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949fa10-c35a-447a-9b65-876987d4b318 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:01.425865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949fa10-c35a-447a-9b65-876987d4b318 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:11:01.427455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949fa10-c35a-447a-9b65-876987d4b318 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:11:01.437677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 765/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:11:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:11:08.563353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafc7be-ee28-478e-8bf4-22adb7456323 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:08.563901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafc7be-ee28-478e-8bf4-22adb7456323 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:08.563901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafc7be-ee28-478e-8bf4-22adb7456323 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:08.565298 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:11:08.570099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59868544-1c78-412f-8a0d-194941c88006 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:08.570550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59868544-1c78-412f-8a0d-194941c88006 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:08.570648 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59868544-1c78-412f-8a0d-194941c88006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:08.591528 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-59868544-1c78-412f-8a0d-194941c88006 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:11:08.592721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-59868544-1c78-412f-8a0d-194941c88006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:08.600418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:11:08.753616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafc7be-ee28-478e-8bf4-22adb7456323 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:11:08.768382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafc7be-ee28-478e-8bf4-22adb7456323 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:11:08.773832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb08224-a61d-484d-82d6-b7626c68c6b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:11:08.774470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb08224-a61d-484d-82d6-b7626c68c6b1 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:08.774755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb08224-a61d-484d-82d6-b7626c68c6b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:08.775031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb08224-a61d-484d-82d6-b7626c68c6b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:08.784003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb08224-a61d-484d-82d6-b7626c68c6b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:11:08.785569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb08224-a61d-484d-82d6-b7626c68c6b1 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:11:08.794949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 758/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:09.659468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6134-e35b-4690-9cb9-9e34710c986f None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:09.660011 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6134-e35b-4690-9cb9-9e34710c986f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:09.660011 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f6134-e35b-4690-9cb9-9e34710c986f None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:09.661410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:11:09.666168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a0879-d24a-4ed5-84a3-1932fbc9b8fd None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:09.666553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a0879-d24a-4ed5-84a3-1932fbc9b8fd None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:09.666717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a0879-d24a-4ed5-84a3-1932fbc9b8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:09.685292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-026a0879-d24a-4ed5-84a3-1932fbc9b8fd None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:11:09.686477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-026a0879-d24a-4ed5-84a3-1932fbc9b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:09.694101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:11:09.843780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6134-e35b-4690-9cb9-9e34710c986f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:11:09.858390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f6134-e35b-4690-9cb9-9e34710c986f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:11:09.863675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb14a5-6142-4905-836a-62e1a4806b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:11:09.864299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb14a5-6142-4905-836a-62e1a4806b85 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:09.864691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb14a5-6142-4905-836a-62e1a4806b85 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:09.864963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb14a5-6142-4905-836a-62e1a4806b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:09.873192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb14a5-6142-4905-836a-62e1a4806b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:11:09.874745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb14a5-6142-4905-836a-62e1a4806b85 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:11:09.883964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 768/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:13.932831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602294-f261-4f7d-9ddd-a8af52b9ae4e None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:13.933934 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602294-f261-4f7d-9ddd-a8af52b9ae4e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:13.934050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602294-f261-4f7d-9ddd-a8af52b9ae4e None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:13.935374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:11:13.940470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5182a-3781-4d02-8a86-e1941c7f005c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:13.940911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5182a-3781-4d02-8a86-e1941c7f005c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:13.941068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5182a-3781-4d02-8a86-e1941c7f005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:13.958622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b8d5182a-3781-4d02-8a86-e1941c7f005c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:11:13.959820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b8d5182a-3781-4d02-8a86-e1941c7f005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:13.967376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:11:14.003754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602294-f261-4f7d-9ddd-a8af52b9ae4e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:11:14.005451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-51602294-f261-4f7d-9ddd-a8af52b9ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:14.062057 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602294-f261-4f7d-9ddd-a8af52b9ae4e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:11:14.065766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289871c-0fa9-4815-bebe-de302735ef0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:11:14.066406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289871c-0fa9-4815-bebe-de302735ef0d service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:14.066685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289871c-0fa9-4815-bebe-de302735ef0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:14.066954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289871c-0fa9-4815-bebe-de302735ef0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:14.075881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289871c-0fa9-4815-bebe-de302735ef0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:11:14.077272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289871c-0fa9-4815-bebe-de302735ef0d service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:11:14.086337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 761/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:16.323407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba02b9-1c1e-4600-9522-229caa950ac0 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:16.324397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba02b9-1c1e-4600-9522-229caa950ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:16.324515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba02b9-1c1e-4600-9522-229caa950ac0 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:16.325846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:11:16.331151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198275-32d1-4907-ad24-a42e7794029e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:16.331557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198275-32d1-4907-ad24-a42e7794029e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:16.331726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198275-32d1-4907-ad24-a42e7794029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:16.349977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d0198275-32d1-4907-ad24-a42e7794029e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:11:16.351218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d0198275-32d1-4907-ad24-a42e7794029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:16.358810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:11:16.393937 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba02b9-1c1e-4600-9522-229caa950ac0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:11:16.405093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba02b9-1c1e-4600-9522-229caa950ac0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:11:16.408562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb31237-7b59-43a2-8bee-835d0ced3c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:11:16.409187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb31237-7b59-43a2-8bee-835d0ced3c20 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:16.409463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb31237-7b59-43a2-8bee-835d0ced3c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:16.409735 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb31237-7b59-43a2-8bee-835d0ced3c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:16.418489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb31237-7b59-43a2-8bee-835d0ced3c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:11:16.419927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb31237-7b59-43a2-8bee-835d0ced3c20 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:11:16.429109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 771/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:20.254314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee986-5756-4b07-ad78-5684895605e2 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:20.254901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee986-5756-4b07-ad78-5684895605e2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:20.254901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee986-5756-4b07-ad78-5684895605e2 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:20.256264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:11:20.261975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65878d78-313e-4cac-ba35-10b18773cde1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:20.262453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65878d78-313e-4cac-ba35-10b18773cde1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:20.262563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65878d78-313e-4cac-ba35-10b18773cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:20.268939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:11:20.281463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-65878d78-313e-4cac-ba35-10b18773cde1 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:11:20.286197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-65878d78-313e-4cac-ba35-10b18773cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:20.290702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:11:20.560674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee986-5756-4b07-ad78-5684895605e2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:11:20.562349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a51ee986-5756-4b07-ad78-5684895605e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:20.568079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=75 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:11:20.618811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee986-5756-4b07-ad78-5684895605e2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:11:20.622497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afecc98-5b33-4ac7-a224-536b26d60cf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:11:20.623159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afecc98-5b33-4ac7-a224-536b26d60cf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:20.623438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afecc98-5b33-4ac7-a224-536b26d60cf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:20.623707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afecc98-5b33-4ac7-a224-536b26d60cf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:20.632352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afecc98-5b33-4ac7-a224-536b26d60cf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:11:20.633747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afecc98-5b33-4ac7-a224-536b26d60cf4 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:11:20.643447 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 764/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:22.876207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d50c-b702-49b7-ac2c-b472e7de10a9 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:22.876820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d50c-b702-49b7-ac2c-b472e7de10a9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:22.876820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d50c-b702-49b7-ac2c-b472e7de10a9 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:22.878125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:11:22.883454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee40d9-4440-47d6-bfda-c79005bfc2ec None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:22.883900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee40d9-4440-47d6-bfda-c79005bfc2ec None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:22.884013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee40d9-4440-47d6-bfda-c79005bfc2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:22.901139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-98ee40d9-4440-47d6-bfda-c79005bfc2ec None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:11:22.902311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-98ee40d9-4440-47d6-bfda-c79005bfc2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:22.909875 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:11:23.177771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d50c-b702-49b7-ac2c-b472e7de10a9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:11:23.179457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e085d50c-b702-49b7-ac2c-b472e7de10a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:23.192253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d50c-b702-49b7-ac2c-b472e7de10a9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:11:23.195647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b4aea-b48f-4ad9-8626-8ccde4d65f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:11:23.196270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4aea-b48f-4ad9-8626-8ccde4d65f4e service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:23.196548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4aea-b48f-4ad9-8626-8ccde4d65f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:23.196818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4aea-b48f-4ad9-8626-8ccde4d65f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:23.205607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b4aea-b48f-4ad9-8626-8ccde4d65f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:11:23.207005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b4aea-b48f-4ad9-8626-8ccde4d65f4e service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:11:23.216902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 774/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:32.896380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=28 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:11:33.212137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=8 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:52.838506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4b227-7e17-4e53-a47e-d25431e2de54 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.839161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4b227-7e17-4e53-a47e-d25431e2de54 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.839161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4b227-7e17-4e53-a47e-d25431e2de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.872322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-68a4b227-7e17-4e53-a47e-d25431e2de54 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:52.873800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-68a4b227-7e17-4e53-a47e-d25431e2de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:52.887640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 766/1540] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:52.895758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ba62-e1ef-4457-b6f3-422fa9a1edbb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.896355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ba62-e1ef-4457-b6f3-422fa9a1edbb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.896355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ba62-e1ef-4457-b6f3-422fa9a1edbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.925152 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1642ba62-e1ef-4457-b6f3-422fa9a1edbb None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:52.925897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb4226-117b-4201-bd9f-67db4f2b2b0f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.926357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1642ba62-e1ef-4457-b6f3-422fa9a1edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:52.926497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb4226-117b-4201-bd9f-67db4f2b2b0f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.926901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb4226-117b-4201-bd9f-67db4f2b2b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.937608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 775/1541] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:52.941996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ba62-e1ef-4457-b6f3-422fa9a1edbb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:52.952244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ba62-e1ef-4457-b6f3-422fa9a1edbb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:52.953383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6efb4226-117b-4201-bd9f-67db4f2b2b0f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:52.954741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6efb4226-117b-4201-bd9f-67db4f2b2b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:52.957218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:52.957884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.958165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.958441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.963371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:52.963806 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:52.965879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:52.965879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jun 02 10:12:52.965879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: Jun 02 10:12:52.967275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:52.969830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 767/1542] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:52.978317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9b059-cd24-48d8-a0b8-5c63ee1b2dac None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.978602 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9b059-cd24-48d8-a0b8-5c63ee1b2dac None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.978876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9b059-cd24-48d8-a0b8-5c63ee1b2dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.986474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 776/1543] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:52.995233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.015941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a087499-ce2f-49c0-92f1-9e889031a6ad admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.017939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b7b9b059-cd24-48d8-a0b8-5c63ee1b2dac None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.019297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b7b9b059-cd24-48d8-a0b8-5c63ee1b2dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.024752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587eb31-cf03-4e91-a6d4-a10b953f2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.025961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587eb31-cf03-4e91-a6d4-a10b953f2cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.026467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587eb31-cf03-4e91-a6d4-a10b953f2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.027649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587eb31-cf03-4e91-a6d4-a10b953f2cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.028681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587eb31-cf03-4e91-a6d4-a10b953f2cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.030896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587eb31-cf03-4e91-a6d4-a10b953f2cb4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.043137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 768/1544] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.043532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786dca-cf4a-4b1f-b21e-324e50b6cfbf None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.043814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786dca-cf4a-4b1f-b21e-324e50b6cfbf None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.044085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15786dca-cf4a-4b1f-b21e-324e50b6cfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.076947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-15786dca-cf4a-4b1f-b21e-324e50b6cfbf None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.078246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-15786dca-cf4a-4b1f-b21e-324e50b6cfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.093610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 769/1545] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.094452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15786dca-cf4a-4b1f-b21e-324e50b6cfbf None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.104503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15786dca-cf4a-4b1f-b21e-324e50b6cfbf None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.119026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd515a-c301-484e-aab7-e3bef7cf92a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.119747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd515a-c301-484e-aab7-e3bef7cf92a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.120016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd515a-c301-484e-aab7-e3bef7cf92a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.120382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd515a-c301-484e-aab7-e3bef7cf92a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.121772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd515a-c301-484e-aab7-e3bef7cf92a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:53.122078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd515a-c301-484e-aab7-e3bef7cf92a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.123841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd515a-c301-484e-aab7-e3bef7cf92a1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.136814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 770/1546] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:53.138170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c536f-4674-4849-a48f-b83502b0f207 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.138451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c536f-4674-4849-a48f-b83502b0f207 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.138724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c536f-4674-4849-a48f-b83502b0f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.164507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6c1c536f-4674-4849-a48f-b83502b0f207 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.165996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6c1c536f-4674-4849-a48f-b83502b0f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.169934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 777/1547] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:12:53.175554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53145520-49cf-4f62-b3af-6de283ce4078 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.175554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53145520-49cf-4f62-b3af-6de283ce4078 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.175554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53145520-49cf-4f62-b3af-6de283ce4078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.195229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-53145520-49cf-4f62-b3af-6de283ce4078 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.196599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-53145520-49cf-4f62-b3af-6de283ce4078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.234614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 771/1548] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.239807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3b039-c47b-42a8-8198-c4a5d068d3d9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.240091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3b039-c47b-42a8-8198-c4a5d068d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.240365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3b039-c47b-42a8-8198-c4a5d068d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.262196 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 778/1549] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.262514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d1e3b039-c47b-42a8-8198-c4a5d068d3d9 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.263370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53145520-49cf-4f62-b3af-6de283ce4078 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.263804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d1e3b039-c47b-42a8-8198-c4a5d068d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.273674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53145520-49cf-4f62-b3af-6de283ce4078 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.275696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 772/1550] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.277046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d6524-6c1c-412e-a601-9456503b776c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.277567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d6524-6c1c-412e-a601-9456503b776c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.277847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d6524-6c1c-412e-a601-9456503b776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.282008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89811c68-9aaa-4c65-9c85-3bc568051eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.282737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811c68-9aaa-4c65-9c85-3bc568051eec admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.283014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811c68-9aaa-4c65-9c85-3bc568051eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.283312 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811c68-9aaa-4c65-9c85-3bc568051eec admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.284033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89811c68-9aaa-4c65-9c85-3bc568051eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.286146 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89811c68-9aaa-4c65-9c85-3bc568051eec admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.296265 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c93d6524-6c1c-412e-a601-9456503b776c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.297462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c93d6524-6c1c-412e-a601-9456503b776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.305205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 773/1551] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.305962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d6524-6c1c-412e-a601-9456503b776c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.315985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d6524-6c1c-412e-a601-9456503b776c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.320648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b8934-48b7-44f4-bab4-0b051cfa620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.321300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8934-48b7-44f4-bab4-0b051cfa620f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.321583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8934-48b7-44f4-bab4-0b051cfa620f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.321859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8934-48b7-44f4-bab4-0b051cfa620f admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.322537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b8934-48b7-44f4-bab4-0b051cfa620f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.325126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b8934-48b7-44f4-bab4-0b051cfa620f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.409712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 774/1552] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:53.411022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bece203-48b8-4632-962a-89d80d0f036a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.411539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bece203-48b8-4632-962a-89d80d0f036a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.411832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bece203-48b8-4632-962a-89d80d0f036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.429923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6bece203-48b8-4632-962a-89d80d0f036a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.431221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6bece203-48b8-4632-962a-89d80d0f036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.440046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 775/1553] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.441247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175ff3-033b-426a-a594-6de8a25fb89c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.441532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175ff3-033b-426a-a594-6de8a25fb89c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.441807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175ff3-033b-426a-a594-6de8a25fb89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.459451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-81175ff3-033b-426a-a594-6de8a25fb89c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.460724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-81175ff3-033b-426a-a594-6de8a25fb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.468451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 776/1554] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.469197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175ff3-033b-426a-a594-6de8a25fb89c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.479073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175ff3-033b-426a-a594-6de8a25fb89c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.484264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1e6b9-82e2-4773-acc4-8e856ab1741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.484923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1e6b9-82e2-4773-acc4-8e856ab1741c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.485205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1e6b9-82e2-4773-acc4-8e856ab1741c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.485476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1e6b9-82e2-4773-acc4-8e856ab1741c admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.486186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1e6b9-82e2-4773-acc4-8e856ab1741c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:53.486491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1e6b9-82e2-4773-acc4-8e856ab1741c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.488108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1e6b9-82e2-4773-acc4-8e856ab1741c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.500054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 777/1555] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:53.501196 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815f12-4eb6-49b0-8cd9-ed615ac1ccd8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.501503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815f12-4eb6-49b0-8cd9-ed615ac1ccd8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.505144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815f12-4eb6-49b0-8cd9-ed615ac1ccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.518478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-57815f12-4eb6-49b0-8cd9-ed615ac1ccd8 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.519675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-57815f12-4eb6-49b0-8cd9-ed615ac1ccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.527350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 778/1556] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.528504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a385e8-a617-4296-a2dd-3441912f8250 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.528806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a385e8-a617-4296-a2dd-3441912f8250 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.529056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a385e8-a617-4296-a2dd-3441912f8250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.545982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-24a385e8-a617-4296-a2dd-3441912f8250 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.547133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-24a385e8-a617-4296-a2dd-3441912f8250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.555015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 779/1557] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.556068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f04f61-93b2-40c8-aee3-e1ce17e8fc07 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.556350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f04f61-93b2-40c8-aee3-e1ce17e8fc07 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.556621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f04f61-93b2-40c8-aee3-e1ce17e8fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.563738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 779/1558] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/projects => generated 373 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:53.565532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89811c68-9aaa-4c65-9c85-3bc568051eec admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.574819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-21f04f61-93b2-40c8-aee3-e1ce17e8fc07 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.576074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-21f04f61-93b2-40c8-aee3-e1ce17e8fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.620589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:53.629362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89811c68-9aaa-4c65-9c85-3bc568051eec admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.634013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bfa56-5cbc-4c21-98e6-ae338661ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.634779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bfa56-5cbc-4c21-98e6-ae338661ead1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.635884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 780/1559] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.636010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bfa56-5cbc-4c21-98e6-ae338661ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.636010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bfa56-5cbc-4c21-98e6-ae338661ead1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.636422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bfa56-5cbc-4c21-98e6-ae338661ead1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.636538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aaa15-d052-4897-ba28-a715e6834182 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.636767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aaa15-d052-4897-ba28-a715e6834182 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.637046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aaa15-d052-4897-ba28-a715e6834182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.638241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bfa56-5cbc-4c21-98e6-ae338661ead1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.648436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 780/1560] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:53.649705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9f221-e70e-4273-b48f-7e43de3f8be0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.649988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9f221-e70e-4273-b48f-7e43de3f8be0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.650265 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9f221-e70e-4273-b48f-7e43de3f8be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.655538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-326aaa15-d052-4897-ba28-a715e6834182 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.657514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-326aaa15-d052-4897-ba28-a715e6834182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.670629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 781/1561] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.670629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326aaa15-d052-4897-ba28-a715e6834182 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.670841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-13c9f221-e70e-4273-b48f-7e43de3f8be0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.670841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-13c9f221-e70e-4273-b48f-7e43de3f8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.676233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326aaa15-d052-4897-ba28-a715e6834182 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.678363 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 781/1562] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:53.679313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9f221-e70e-4273-b48f-7e43de3f8be0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.684332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591d1c0-e332-457b-857c-20582a4d1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.685338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591d1c0-e332-457b-857c-20582a4d1637 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.686073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591d1c0-e332-457b-857c-20582a4d1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.686348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591d1c0-e332-457b-857c-20582a4d1637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.687038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591d1c0-e332-457b-857c-20582a4d1637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.688076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-a591d1c0-e332-457b-857c-20582a4d1637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:53.688076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jun 02 10:12:53.688076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: Jun 02 10:12:53.689249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591d1c0-e332-457b-857c-20582a4d1637 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.689516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9f221-e70e-4273-b48f-7e43de3f8be0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.694017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7c4ed-235c-44a0-865c-af9b8cf44dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.694805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7c4ed-235c-44a0-865c-af9b8cf44dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.695083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7c4ed-235c-44a0-865c-af9b8cf44dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.695383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7c4ed-235c-44a0-865c-af9b8cf44dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.696123 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7c4ed-235c-44a0-865c-af9b8cf44dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:53.696424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7c4ed-235c-44a0-865c-af9b8cf44dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.697984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7c4ed-235c-44a0-865c-af9b8cf44dc1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.709519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 782/1563] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:53.710309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7c4ed-235c-44a0-865c-af9b8cf44dc1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.719701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7c4ed-235c-44a0-865c-af9b8cf44dc1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.724206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f4103-3a52-4edc-be71-fc5b08a7906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.724820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f4103-3a52-4edc-be71-fc5b08a7906d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.725098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f4103-3a52-4edc-be71-fc5b08a7906d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.725369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f4103-3a52-4edc-be71-fc5b08a7906d admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.726060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f4103-3a52-4edc-be71-fc5b08a7906d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:53.726391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f4103-3a52-4edc-be71-fc5b08a7906d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.727986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f4103-3a52-4edc-be71-fc5b08a7906d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.737134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:53.742721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 783/1564] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:53.742721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f4103-3a52-4edc-be71-fc5b08a7906d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.750825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f4103-3a52-4edc-be71-fc5b08a7906d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.755320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226af8-0b89-40e5-bda9-24a7d048b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.755978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226af8-0b89-40e5-bda9-24a7d048b271 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.756258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226af8-0b89-40e5-bda9-24a7d048b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.756532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226af8-0b89-40e5-bda9-24a7d048b271 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.757184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3226af8-0b89-40e5-bda9-24a7d048b271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.758138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-c3226af8-0b89-40e5-bda9-24a7d048b271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:53.758138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jun 02 10:12:53.758138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: Jun 02 10:12:53.759386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3226af8-0b89-40e5-bda9-24a7d048b271 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.769547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 782/1565] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:53.769547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591d1c0-e332-457b-857c-20582a4d1637 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.828214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591d1c0-e332-457b-857c-20582a4d1637 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.832797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5fb5d-e623-4fcb-b8c3-6566580504d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.833449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fb5d-e623-4fcb-b8c3-6566580504d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.833732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fb5d-e623-4fcb-b8c3-6566580504d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.834031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fb5d-e623-4fcb-b8c3-6566580504d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.834746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5fb5d-e623-4fcb-b8c3-6566580504d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:53.835049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5fb5d-e623-4fcb-b8c3-6566580504d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.836658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5fb5d-e623-4fcb-b8c3-6566580504d6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.849101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 783/1566] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:53.849874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5fb5d-e623-4fcb-b8c3-6566580504d6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.860072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5fb5d-e623-4fcb-b8c3-6566580504d6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.875875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 784/1567] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:53.875875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226af8-0b89-40e5-bda9-24a7d048b271 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.876119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35703761-43b1-4f14-9515-9a08c7f5f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.876119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35703761-43b1-4f14-9515-9a08c7f5f7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.876119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35703761-43b1-4f14-9515-9a08c7f5f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.876119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35703761-43b1-4f14-9515-9a08c7f5f7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.876515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35703761-43b1-4f14-9515-9a08c7f5f7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.876515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35703761-43b1-4f14-9515-9a08c7f5f7e6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.876690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226af8-0b89-40e5-bda9-24a7d048b271 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.878602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa9946-65ba-4b9b-819e-e48ca4d8d4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.882040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 784/1568] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:53.882197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa9946-65ba-4b9b-819e-e48ca4d8d4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.882197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa9946-65ba-4b9b-819e-e48ca4d8d4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.882197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa9946-65ba-4b9b-819e-e48ca4d8d4f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.882428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35703761-43b1-4f14-9515-9a08c7f5f7e6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.882515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa9946-65ba-4b9b-819e-e48ca4d8d4f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:53.882515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa9946-65ba-4b9b-819e-e48ca4d8d4f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.882515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa9946-65ba-4b9b-819e-e48ca4d8d4f3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.889210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35703761-43b1-4f14-9515-9a08c7f5f7e6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.893920 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df756b-3417-4104-b2fb-1d716a7586f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.894554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df756b-3417-4104-b2fb-1d716a7586f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.894829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df756b-3417-4104-b2fb-1d716a7586f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.895210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df756b-3417-4104-b2fb-1d716a7586f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.903038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 785/1569] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:53.903562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df756b-3417-4104-b2fb-1d716a7586f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:53.903562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df756b-3417-4104-b2fb-1d716a7586f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.903727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa9946-65ba-4b9b-819e-e48ca4d8d4f3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.903811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df756b-3417-4104-b2fb-1d716a7586f8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.907969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa9946-65ba-4b9b-819e-e48ca4d8d4f3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.914209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 785/1570] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:53.914209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df756b-3417-4104-b2fb-1d716a7586f8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.916436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a5bf9-dff4-4cbd-9f9a-7e8f59816172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.917086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a5bf9-dff4-4cbd-9f9a-7e8f59816172 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.917368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a5bf9-dff4-4cbd-9f9a-7e8f59816172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.918586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a5bf9-dff4-4cbd-9f9a-7e8f59816172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.918975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a5bf9-dff4-4cbd-9f9a-7e8f59816172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.920949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a5bf9-dff4-4cbd-9f9a-7e8f59816172 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.924485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df756b-3417-4104-b2fb-1d716a7586f8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.928918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a4733-d4df-4a5d-bf4f-c239c34811a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.929550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a4733-d4df-4a5d-bf4f-c239c34811a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.929823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a4733-d4df-4a5d-bf4f-c239c34811a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.930096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a4733-d4df-4a5d-bf4f-c239c34811a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.931120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a4733-d4df-4a5d-bf4f-c239c34811a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.932629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a4733-d4df-4a5d-bf4f-c239c34811a6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.010678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 786/1571] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.011656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a5bf9-dff4-4cbd-9f9a-7e8f59816172 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.047247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 786/1572] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.047247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a4733-d4df-4a5d-bf4f-c239c34811a6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.076089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a5bf9-dff4-4cbd-9f9a-7e8f59816172 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.108889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a4733-d4df-4a5d-bf4f-c239c34811a6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.113450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf3c5e-b528-4c88-b61c-e1abb4adaf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.114103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf3c5e-b528-4c88-b61c-e1abb4adaf13 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.114382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf3c5e-b528-4c88-b61c-e1abb4adaf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.114653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf3c5e-b528-4c88-b61c-e1abb4adaf13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.115384 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf3c5e-b528-4c88-b61c-e1abb4adaf13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.117271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf3c5e-b528-4c88-b61c-e1abb4adaf13 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.131285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:54.131438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fc38-776d-480a-af49-93b63eefdb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.132055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fc38-776d-480a-af49-93b63eefdb4b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.132340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fc38-776d-480a-af49-93b63eefdb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.132637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fc38-776d-480a-af49-93b63eefdb4b admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.133321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734fc38-776d-480a-af49-93b63eefdb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.135227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734fc38-776d-480a-af49-93b63eefdb4b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.234731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 787/1573] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/projects => generated 403 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.235595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf3c5e-b528-4c88-b61c-e1abb4adaf13 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.267956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 787/1574] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.268965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fc38-776d-480a-af49-93b63eefdb4b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.279834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fc38-776d-480a-af49-93b63eefdb4b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.305259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf3c5e-b528-4c88-b61c-e1abb4adaf13 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.310153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c890b96-76a4-4ac3-b0d9-7e3ae8764dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.310822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c890b96-76a4-4ac3-b0d9-7e3ae8764dea admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.311115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c890b96-76a4-4ac3-b0d9-7e3ae8764dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.311397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c890b96-76a4-4ac3-b0d9-7e3ae8764dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.312114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c890b96-76a4-4ac3-b0d9-7e3ae8764dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.313851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c890b96-76a4-4ac3-b0d9-7e3ae8764dea admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.321927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:54.323573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 788/1575] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:54.324944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c890b96-76a4-4ac3-b0d9-7e3ae8764dea admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.333951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c890b96-76a4-4ac3-b0d9-7e3ae8764dea admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.336901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21250a-e3ee-4d5c-bc5e-84c8d58ac76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.337795 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21250a-e3ee-4d5c-bc5e-84c8d58ac76c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.338199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21250a-e3ee-4d5c-bc5e-84c8d58ac76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.338333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21250a-e3ee-4d5c-bc5e-84c8d58ac76c admin admin] PATH_INFO: `/v3/projects/9577f74cfd16471fb9430a348ee2abe1/users/47d68f62b562431a9afadcb47e980cd9/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.338727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11652-2dd6-4dca-89cc-b0e6d211ce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.339397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11652-2dd6-4dca-89cc-b0e6d211ce73 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.340301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11652-2dd6-4dca-89cc-b0e6d211ce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.340574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11652-2dd6-4dca-89cc-b0e6d211ce73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.341283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d11652-2dd6-4dca-89cc-b0e6d211ce73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.343223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d11652-2dd6-4dca-89cc-b0e6d211ce73 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.353852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21250a-e3ee-4d5c-bc5e-84c8d58ac76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9577f74cfd16471fb9430a348ee2abe1, user_id=47d68f62b562431a9afadcb47e980cd9, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.357102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21250a-e3ee-4d5c-bc5e-84c8d58ac76c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.434735 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 788/1576] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:54 2022] PUT /identity/v3/projects/9577f74cfd16471fb9430a348ee2abe1/users/47d68f62b562431a9afadcb47e980cd9/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:54.435661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21250a-e3ee-4d5c-bc5e-84c8d58ac76c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.436722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 789/1577] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.437682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11652-2dd6-4dca-89cc-b0e6d211ce73 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.502339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21250a-e3ee-4d5c-bc5e-84c8d58ac76c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.505992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11652-2dd6-4dca-89cc-b0e6d211ce73 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.506963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dcbee-96e9-46e7-8af0-2569305b8340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.507693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dcbee-96e9-46e7-8af0-2569305b8340 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.507977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dcbee-96e9-46e7-8af0-2569305b8340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.508253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dcbee-96e9-46e7-8af0-2569305b8340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.508941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dcbee-96e9-46e7-8af0-2569305b8340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.510599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebb2be-f287-4e86-839f-5026eefab571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.510837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dcbee-96e9-46e7-8af0-2569305b8340 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.511788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebb2be-f287-4e86-839f-5026eefab571 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.512067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebb2be-f287-4e86-839f-5026eefab571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.512336 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebb2be-f287-4e86-839f-5026eefab571 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.513010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebb2be-f287-4e86-839f-5026eefab571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.514880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebb2be-f287-4e86-839f-5026eefab571 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.593214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 790/1578] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.594163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebb2be-f287-4e86-839f-5026eefab571 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.603511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebb2be-f287-4e86-839f-5026eefab571 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.608111 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d8da5-5ccc-413f-9ea9-6e943daee2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.608731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d8da5-5ccc-413f-9ea9-6e943daee2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.609012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d8da5-5ccc-413f-9ea9-6e943daee2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.609311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d8da5-5ccc-413f-9ea9-6e943daee2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.609988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d8da5-5ccc-413f-9ea9-6e943daee2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.611899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d8da5-5ccc-413f-9ea9-6e943daee2c1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.616983 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 789/1579] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.617668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dcbee-96e9-46e7-8af0-2569305b8340 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.680278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dcbee-96e9-46e7-8af0-2569305b8340 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.685320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e5a43-9668-4800-92b3-879da5b19c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.685984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5a43-9668-4800-92b3-879da5b19c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.686261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5a43-9668-4800-92b3-879da5b19c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.686531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5a43-9668-4800-92b3-879da5b19c84 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.687242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e5a43-9668-4800-92b3-879da5b19c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.689151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e5a43-9668-4800-92b3-879da5b19c84 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.697966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 791/1580] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.699627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d8da5-5ccc-413f-9ea9-6e943daee2c1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.708960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d8da5-5ccc-413f-9ea9-6e943daee2c1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.713483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9138d-07cb-4a4d-afba-af63c5b3b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.714117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9138d-07cb-4a4d-afba-af63c5b3b608 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.714394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9138d-07cb-4a4d-afba-af63c5b3b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.714662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9138d-07cb-4a4d-afba-af63c5b3b608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.715392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9138d-07cb-4a4d-afba-af63c5b3b608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.716943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9138d-07cb-4a4d-afba-af63c5b3b608 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.727194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 792/1581] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:54.727942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9138d-07cb-4a4d-afba-af63c5b3b608 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.736815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9138d-07cb-4a4d-afba-af63c5b3b608 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.741270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf1d9d-0860-4fac-9797-6ff3a83d702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.741867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf1d9d-0860-4fac-9797-6ff3a83d702f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.742143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf1d9d-0860-4fac-9797-6ff3a83d702f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.742410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf1d9d-0860-4fac-9797-6ff3a83d702f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.743089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf1d9d-0860-4fac-9797-6ff3a83d702f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.744601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf1d9d-0860-4fac-9797-6ff3a83d702f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.755308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 793/1582] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:54.756132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf1d9d-0860-4fac-9797-6ff3a83d702f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.766255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf1d9d-0860-4fac-9797-6ff3a83d702f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.771138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2eb0e3-5c51-48fe-934c-60842c238c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.771795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eb0e3-5c51-48fe-934c-60842c238c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.772072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eb0e3-5c51-48fe-934c-60842c238c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.772344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eb0e3-5c51-48fe-934c-60842c238c54 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.773012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2eb0e3-5c51-48fe-934c-60842c238c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.774894 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2eb0e3-5c51-48fe-934c-60842c238c54 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.777755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 790/1583] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/users => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.779697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630be88-4a84-4dd0-822e-f74e4f08f199 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.780126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630be88-4a84-4dd0-822e-f74e4f08f199 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.780538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630be88-4a84-4dd0-822e-f74e4f08f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.807255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5630be88-4a84-4dd0-822e-f74e4f08f199 None None] MFA Rules not processed for user `47d68f62b562431a9afadcb47e980cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:54.809037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5630be88-4a84-4dd0-822e-f74e4f08f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:54.838650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:54.866991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 794/1584] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/users => generated 282 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.867924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2eb0e3-5c51-48fe-934c-60842c238c54 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.872016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 791/1585] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:54.872829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630be88-4a84-4dd0-822e-f74e4f08f199 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.875858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:54.879411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2eb0e3-5c51-48fe-934c-60842c238c54 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.882582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630be88-4a84-4dd0-822e-f74e4f08f199 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.884138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec560b09-11bb-4673-9440-052f27f7ab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.884794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec560b09-11bb-4673-9440-052f27f7ab77 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.885076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec560b09-11bb-4673-9440-052f27f7ab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.885350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec560b09-11bb-4673-9440-052f27f7ab77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.886072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec560b09-11bb-4673-9440-052f27f7ab77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.887570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a5cc2-f332-4748-b3c9-75675d5b13e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.888466 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec560b09-11bb-4673-9440-052f27f7ab77 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.888622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5cc2-f332-4748-b3c9-75675d5b13e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.888803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5cc2-f332-4748-b3c9-75675d5b13e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.889182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5cc2-f332-4748-b3c9-75675d5b13e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.890028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a5cc2-f332-4748-b3c9-75675d5b13e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.892505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a5cc2-f332-4748-b3c9-75675d5b13e3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.899128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 795/1586] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:54.899828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec560b09-11bb-4673-9440-052f27f7ab77 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.909141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec560b09-11bb-4673-9440-052f27f7ab77 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.913671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a17bc-76db-46af-9452-d322a1e8e888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.914296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a17bc-76db-46af-9452-d322a1e8e888 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.914580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a17bc-76db-46af-9452-d322a1e8e888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.914854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a17bc-76db-46af-9452-d322a1e8e888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.915595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a17bc-76db-46af-9452-d322a1e8e888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.917179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a17bc-76db-46af-9452-d322a1e8e888 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.926821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 796/1587] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:54.927619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a17bc-76db-46af-9452-d322a1e8e888 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.937330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a17bc-76db-46af-9452-d322a1e8e888 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.942432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768499b-8183-4976-9033-018509080b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.943063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768499b-8183-4976-9033-018509080b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.943428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768499b-8183-4976-9033-018509080b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.943703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768499b-8183-4976-9033-018509080b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.944393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768499b-8183-4976-9033-018509080b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.945905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768499b-8183-4976-9033-018509080b1f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.956266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 797/1588] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:54.957014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768499b-8183-4976-9033-018509080b1f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.966288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768499b-8183-4976-9033-018509080b1f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.970838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9adc-a308-412a-94e3-f3fc7e49e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.971703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9adc-a308-412a-94e3-f3fc7e49e020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.971984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9adc-a308-412a-94e3-f3fc7e49e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.972257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9adc-a308-412a-94e3-f3fc7e49e020 admin admin] PATH_INFO: `/v3/projects/6beed4978c174ffe81c6ee8ea79ae7f3/users/20cbad694976400f94f2d0e6a63cdb98/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.978072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 792/1589] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:54.979004 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a5cc2-f332-4748-b3c9-75675d5b13e3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.987115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf9adc-a308-412a-94e3-f3fc7e49e020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6beed4978c174ffe81c6ee8ea79ae7f3, user_id=20cbad694976400f94f2d0e6a63cdb98, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.988173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-45bf9adc-a308-412a-94e3-f3fc7e49e020 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:54.988173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jun 02 10:12:54.988173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: Jun 02 10:12:54.990108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf9adc-a308-412a-94e3-f3fc7e49e020 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.990976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a5cc2-f332-4748-b3c9-75675d5b13e3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.996529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876af9c4-71c6-48dd-b3e5-04040e668eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.997199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876af9c4-71c6-48dd-b3e5-04040e668eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.997483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876af9c4-71c6-48dd-b3e5-04040e668eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.997810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876af9c4-71c6-48dd-b3e5-04040e668eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.998572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876af9c4-71c6-48dd-b3e5-04040e668eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.000230 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876af9c4-71c6-48dd-b3e5-04040e668eaa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.013240 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 793/1590] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:55.013240 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876af9c4-71c6-48dd-b3e5-04040e668eaa admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.020770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876af9c4-71c6-48dd-b3e5-04040e668eaa admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.025245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b126ed-6922-445a-8aca-8d38fe40f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.025910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b126ed-6922-445a-8aca-8d38fe40f6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.026192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b126ed-6922-445a-8aca-8d38fe40f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.026467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b126ed-6922-445a-8aca-8d38fe40f6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.027268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b126ed-6922-445a-8aca-8d38fe40f6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.028818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b126ed-6922-445a-8aca-8d38fe40f6f5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.039057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 794/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:55.039899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b126ed-6922-445a-8aca-8d38fe40f6f5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.049577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b126ed-6922-445a-8aca-8d38fe40f6f5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.061183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc521d7-d0ba-462e-a9e8-4991d4b8151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.061183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc521d7-d0ba-462e-a9e8-4991d4b8151f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.061183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc521d7-d0ba-462e-a9e8-4991d4b8151f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.061183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc521d7-d0ba-462e-a9e8-4991d4b8151f admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.061550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc521d7-d0ba-462e-a9e8-4991d4b8151f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.061550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc521d7-d0ba-462e-a9e8-4991d4b8151f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.121622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 798/1592] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:54 2022] PUT /identity/v3/projects/6beed4978c174ffe81c6ee8ea79ae7f3/users/20cbad694976400f94f2d0e6a63cdb98/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:55.122462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9adc-a308-412a-94e3-f3fc7e49e020 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.150689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 795/1593] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:55.155034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc521d7-d0ba-462e-a9e8-4991d4b8151f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.187702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9adc-a308-412a-94e3-f3fc7e49e020 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.214995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc521d7-d0ba-462e-a9e8-4991d4b8151f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.219620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d600be-7d4a-4b33-9241-6b5adf1f2797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.220285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d600be-7d4a-4b33-9241-6b5adf1f2797 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.220565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d600be-7d4a-4b33-9241-6b5adf1f2797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.220844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d600be-7d4a-4b33-9241-6b5adf1f2797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.221563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d600be-7d4a-4b33-9241-6b5adf1f2797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.223161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d600be-7d4a-4b33-9241-6b5adf1f2797 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.233675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 796/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:55.234458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d600be-7d4a-4b33-9241-6b5adf1f2797 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.244243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d600be-7d4a-4b33-9241-6b5adf1f2797 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.245125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e8cd-ff55-4d2c-a450-1a108e980e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.246575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e8cd-ff55-4d2c-a450-1a108e980e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.246859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e8cd-ff55-4d2c-a450-1a108e980e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.247169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e8cd-ff55-4d2c-a450-1a108e980e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.247895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843e8cd-ff55-4d2c-a450-1a108e980e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.249479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843e8cd-ff55-4d2c-a450-1a108e980e2e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.249710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d007aa-ddc7-42d8-8dcc-44cff3be56b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.250556 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d007aa-ddc7-42d8-8dcc-44cff3be56b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.250834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d007aa-ddc7-42d8-8dcc-44cff3be56b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.251126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d007aa-ddc7-42d8-8dcc-44cff3be56b8 admin admin] PATH_INFO: `/v3/projects/0025aa9f920f45729d8516c9e315e448/users/aea254e4bdc142b9ae1767335fd84d61/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.259456 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 799/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:55.264113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e8cd-ff55-4d2c-a450-1a108e980e2e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.268000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d007aa-ddc7-42d8-8dcc-44cff3be56b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0025aa9f920f45729d8516c9e315e448, user_id=aea254e4bdc142b9ae1767335fd84d61, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.270758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d007aa-ddc7-42d8-8dcc-44cff3be56b8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.273406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e8cd-ff55-4d2c-a450-1a108e980e2e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.278154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54df111-89c1-40a3-a01a-d965edfefb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.278819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54df111-89c1-40a3-a01a-d965edfefb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.279119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54df111-89c1-40a3-a01a-d965edfefb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.279405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54df111-89c1-40a3-a01a-d965edfefb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.280126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54df111-89c1-40a3-a01a-d965edfefb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.281691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54df111-89c1-40a3-a01a-d965edfefb16 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.291608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 800/1596] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:55.292379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54df111-89c1-40a3-a01a-d965edfefb16 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.302090 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54df111-89c1-40a3-a01a-d965edfefb16 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.306702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ed78-b523-4a6f-a574-3c82e73ee976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.312212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ed78-b523-4a6f-a574-3c82e73ee976 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.312212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ed78-b523-4a6f-a574-3c82e73ee976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.312212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ed78-b523-4a6f-a574-3c82e73ee976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.312212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2ed78-b523-4a6f-a574-3c82e73ee976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.312212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2ed78-b523-4a6f-a574-3c82e73ee976 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.321292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 801/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:55.322178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ed78-b523-4a6f-a574-3c82e73ee976 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.331333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ed78-b523-4a6f-a574-3c82e73ee976 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.335883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db863919-8ac3-4f24-ac8e-6041c6a5ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.336483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db863919-8ac3-4f24-ac8e-6041c6a5ae0d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.336765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db863919-8ac3-4f24-ac8e-6041c6a5ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.337031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db863919-8ac3-4f24-ac8e-6041c6a5ae0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.337719 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db863919-8ac3-4f24-ac8e-6041c6a5ae0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.339245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db863919-8ac3-4f24-ac8e-6041c6a5ae0d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.348800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 802/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:55.350068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a82752-5164-4048-a6c8-5c1b42b3f5e4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.350356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a82752-5164-4048-a6c8-5c1b42b3f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.350628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a82752-5164-4048-a6c8-5c1b42b3f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.360139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 797/1599] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:55 2022] PUT /identity/v3/projects/0025aa9f920f45729d8516c9e315e448/users/aea254e4bdc142b9ae1767335fd84d61/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:55.361525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d007aa-ddc7-42d8-8dcc-44cff3be56b8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.381159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-17a82752-5164-4048-a6c8-5c1b42b3f5e4 None None] MFA Rules not processed for user `20cbad694976400f94f2d0e6a63cdb98`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:55.382367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-17a82752-5164-4048-a6c8-5c1b42b3f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:55.386527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:55.410461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:55.427606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d007aa-ddc7-42d8-8dcc-44cff3be56b8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.432307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824bbc6-d7ae-4745-921f-d759f6c98d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.432964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824bbc6-d7ae-4745-921f-d759f6c98d55 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.433309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824bbc6-d7ae-4745-921f-d759f6c98d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.433541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824bbc6-d7ae-4745-921f-d759f6c98d55 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.434215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824bbc6-d7ae-4745-921f-d759f6c98d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.436158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824bbc6-d7ae-4745-921f-d759f6c98d55 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.445898 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 803/1600] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:55.446781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a82752-5164-4048-a6c8-5c1b42b3f5e4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.456713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a82752-5164-4048-a6c8-5c1b42b3f5e4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.461470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124555a-27bb-4fc8-a07f-2576258d1bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.462353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124555a-27bb-4fc8-a07f-2576258d1bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.462632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124555a-27bb-4fc8-a07f-2576258d1bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.462906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124555a-27bb-4fc8-a07f-2576258d1bad admin admin] PATH_INFO: `/v3/projects/bec195176b7f48239fba6463a4828a18/users/a6d26b1c907f432a9666744901f2d315/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.477917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124555a-27bb-4fc8-a07f-2576258d1bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec195176b7f48239fba6463a4828a18, user_id=a6d26b1c907f432a9666744901f2d315, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.481185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124555a-27bb-4fc8-a07f-2576258d1bad admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.515727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 798/1601] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:55.516563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824bbc6-d7ae-4745-921f-d759f6c98d55 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.526551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824bbc6-d7ae-4745-921f-d759f6c98d55 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.531677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7936c7-2d1e-446b-9a49-2906d095074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.532527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7936c7-2d1e-446b-9a49-2906d095074c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.532811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7936c7-2d1e-446b-9a49-2906d095074c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.533103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7936c7-2d1e-446b-9a49-2906d095074c admin admin] PATH_INFO: `/v3/projects/86951ec86e2046c3bbba0ba1bc6738e2/users/a696d00855ef439c9d80b6bec5312f20/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.549177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7936c7-2d1e-446b-9a49-2906d095074c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86951ec86e2046c3bbba0ba1bc6738e2, user_id=a696d00855ef439c9d80b6bec5312f20, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.551900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7936c7-2d1e-446b-9a49-2906d095074c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.581391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 804/1602] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:55 2022] PUT /identity/v3/projects/bec195176b7f48239fba6463a4828a18/users/a6d26b1c907f432a9666744901f2d315/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:55.582228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124555a-27bb-4fc8-a07f-2576258d1bad admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.633269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 799/1603] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:55 2022] PUT /identity/v3/projects/86951ec86e2046c3bbba0ba1bc6738e2/users/a696d00855ef439c9d80b6bec5312f20/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:55.633913 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7936c7-2d1e-446b-9a49-2906d095074c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.645449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124555a-27bb-4fc8-a07f-2576258d1bad admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.696088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7936c7-2d1e-446b-9a49-2906d095074c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.700809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb107344-aa19-421e-890a-3b2fdfb46c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.701762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb107344-aa19-421e-890a-3b2fdfb46c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.702046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb107344-aa19-421e-890a-3b2fdfb46c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.702317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb107344-aa19-421e-890a-3b2fdfb46c09 admin admin] PATH_INFO: `/v3/projects/0a2004683a1943e4b8b60aba677c09c5/users/36fe013401be4085aa5ba0473dae000b/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.702664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c2fd6-0a9e-4b6a-a8fd-d3850f69d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.703450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c2fd6-0a9e-4b6a-a8fd-d3850f69d1dc admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.703762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c2fd6-0a9e-4b6a-a8fd-d3850f69d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.704033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c2fd6-0a9e-4b6a-a8fd-d3850f69d1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.704757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c2fd6-0a9e-4b6a-a8fd-d3850f69d1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.706393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c2fd6-0a9e-4b6a-a8fd-d3850f69d1dc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.717804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 805/1604] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:55.717804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c2fd6-0a9e-4b6a-a8fd-d3850f69d1dc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.721162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb107344-aa19-421e-890a-3b2fdfb46c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2004683a1943e4b8b60aba677c09c5, user_id=36fe013401be4085aa5ba0473dae000b, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.721775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb107344-aa19-421e-890a-3b2fdfb46c09 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.728193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c2fd6-0a9e-4b6a-a8fd-d3850f69d1dc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.733329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b288270-0106-4994-90cc-1919e152e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.734184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288270-0106-4994-90cc-1919e152e127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.734457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288270-0106-4994-90cc-1919e152e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.734722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288270-0106-4994-90cc-1919e152e127 admin admin] PATH_INFO: `/v3/projects/b9440ff46d69454eba60eec875d91c43/users/f364bffaa2674cf9b8390b40195312de/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.749034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b288270-0106-4994-90cc-1919e152e127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9440ff46d69454eba60eec875d91c43, user_id=f364bffaa2674cf9b8390b40195312de, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.751636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b288270-0106-4994-90cc-1919e152e127 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.792857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 800/1605] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:55 2022] PUT /identity/v3/projects/0a2004683a1943e4b8b60aba677c09c5/users/36fe013401be4085aa5ba0473dae000b/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:55.797295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c1028-9729-4208-9be4-0d6df5dc032c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.797295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c1028-9729-4208-9be4-0d6df5dc032c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.797295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c1028-9729-4208-9be4-0d6df5dc032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.811335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-620c1028-9729-4208-9be4-0d6df5dc032c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:55.812538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-620c1028-9729-4208-9be4-0d6df5dc032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:55.851036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:55.866211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 806/1606] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:55 2022] PUT /identity/v3/projects/b9440ff46d69454eba60eec875d91c43/users/f364bffaa2674cf9b8390b40195312de/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:55.866211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2715830-b4af-454c-b035-d47d99e3e083 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.866211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2715830-b4af-454c-b035-d47d99e3e083 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.866211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2715830-b4af-454c-b035-d47d99e3e083 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.866211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 807/1607] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 2 10:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:12:55.866211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2715830-b4af-454c-b035-d47d99e3e083 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.872632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 801/1608] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:55.873994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c4627-89d7-4391-9a37-41f902cb5891 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.874284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c4627-89d7-4391-9a37-41f902cb5891 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.874558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c4627-89d7-4391-9a37-41f902cb5891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.903470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-633c4627-89d7-4391-9a37-41f902cb5891 None None] MFA Rules not processed for user `a6d26b1c907f432a9666744901f2d315`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:55.904678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-633c4627-89d7-4391-9a37-41f902cb5891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:55.922995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:55.925453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2715830-b4af-454c-b035-d47d99e3e083 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.930225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d9c61-2f96-4e02-972c-3c0cf053725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.930896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d9c61-2f96-4e02-972c-3c0cf053725e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.931211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d9c61-2f96-4e02-972c-3c0cf053725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.931493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d9c61-2f96-4e02-972c-3c0cf053725e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.932227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d9c61-2f96-4e02-972c-3c0cf053725e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.933808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d9c61-2f96-4e02-972c-3c0cf053725e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.944765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 808/1609] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:55.946626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86aee5-c1f1-4e8d-a56c-3c8d959607ce None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.946626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86aee5-c1f1-4e8d-a56c-3c8d959607ce None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.946626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86aee5-c1f1-4e8d-a56c-3c8d959607ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.963928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bb86aee5-c1f1-4e8d-a56c-3c8d959607ce None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:55.965807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bb86aee5-c1f1-4e8d-a56c-3c8d959607ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:55.973227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 802/1610] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:55.977124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 809/1611] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:55.981979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c4627-89d7-4391-9a37-41f902cb5891 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.982337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e6645-e88a-4378-8de5-456e4254a1e6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.982337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e6645-e88a-4378-8de5-456e4254a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.982337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e6645-e88a-4378-8de5-456e4254a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.992723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c4627-89d7-4391-9a37-41f902cb5891 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.997647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c81e87-e2ee-4329-a166-19ec5feac908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.998524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81e87-e2ee-4329-a166-19ec5feac908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.998892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81e87-e2ee-4329-a166-19ec5feac908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.999278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c81e87-e2ee-4329-a166-19ec5feac908 admin admin] PATH_INFO: `/v3/projects/ea502039a02d4d5db21dcc41c98a52a5/users/0514d3b22d94435196f8bf1eff26699e/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.003724 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5c6e6645-e88a-4378-8de5-456e4254a1e6 None None] MFA Rules not processed for user `36fe013401be4085aa5ba0473dae000b`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:56.004922 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5c6e6645-e88a-4378-8de5-456e4254a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:56.014980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c81e87-e2ee-4329-a166-19ec5feac908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea502039a02d4d5db21dcc41c98a52a5, user_id=0514d3b22d94435196f8bf1eff26699e, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.017666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c81e87-e2ee-4329-a166-19ec5feac908 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.067567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 810/1612] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:56.068793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c4f9-bad8-4188-954b-7364bc2e4cbe None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.069075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c4f9-bad8-4188-954b-7364bc2e4cbe None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.069344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c4f9-bad8-4188-954b-7364bc2e4cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.093841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 803/1613] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:55 2022] PUT /identity/v3/projects/ea502039a02d4d5db21dcc41c98a52a5/users/0514d3b22d94435196f8bf1eff26699e/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:56.094917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b264c4f9-bad8-4188-954b-7364bc2e4cbe None None] MFA Rules not processed for user `f364bffaa2674cf9b8390b40195312de`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:56.096116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081405d-319c-434a-a1f9-d783663da67c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.096360 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b264c4f9-bad8-4188-954b-7364bc2e4cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:56.096637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081405d-319c-434a-a1f9-d783663da67c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.097120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081405d-319c-434a-a1f9-d783663da67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.116129 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e081405d-319c-434a-a1f9-d783663da67c None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:56.117310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e081405d-319c-434a-a1f9-d783663da67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:56.160589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 811/1614] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:56.161605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c4f9-bad8-4188-954b-7364bc2e4cbe None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.170651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:56.184909 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 804/1615] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 2 10:12:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:56.185738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081405d-319c-434a-a1f9-d783663da67c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.216029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c4f9-bad8-4188-954b-7364bc2e4cbe None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.220129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a450d-5b02-4c33-b195-e2542039eff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.220781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a450d-5b02-4c33-b195-e2542039eff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.221064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a450d-5b02-4c33-b195-e2542039eff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.221336 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a450d-5b02-4c33-b195-e2542039eff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.247968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081405d-319c-434a-a1f9-d783663da67c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.252452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaebffc-2c70-46c0-a1c4-a3224dd77d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.253329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaebffc-2c70-46c0-a1c4-a3224dd77d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.253605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaebffc-2c70-46c0-a1c4-a3224dd77d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.253878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaebffc-2c70-46c0-a1c4-a3224dd77d24 admin admin] PATH_INFO: `/v3/projects/d871f345cb3b47ebbecf49bc9322298f/users/50e541707b4a4d9aa6c392fd93c2f872/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.271198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaebffc-2c70-46c0-a1c4-a3224dd77d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d871f345cb3b47ebbecf49bc9322298f, user_id=50e541707b4a4d9aa6c392fd93c2f872, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.273895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaebffc-2c70-46c0-a1c4-a3224dd77d24 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.286223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a450d-5b02-4c33-b195-e2542039eff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.287819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a450d-5b02-4c33-b195-e2542039eff3 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.297306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 812/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:56.298165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a450d-5b02-4c33-b195-e2542039eff3 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.299549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-442a450d-5b02-4c33-b195-e2542039eff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:56.310685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a450d-5b02-4c33-b195-e2542039eff3 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.314437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276bf74-7e13-4f37-94cf-f29ce1181971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.315070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276bf74-7e13-4f37-94cf-f29ce1181971 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.315379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276bf74-7e13-4f37-94cf-f29ce1181971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.315650 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276bf74-7e13-4f37-94cf-f29ce1181971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.325175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276bf74-7e13-4f37-94cf-f29ce1181971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.326497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276bf74-7e13-4f37-94cf-f29ce1181971 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.335829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 813/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:56.336667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276bf74-7e13-4f37-94cf-f29ce1181971 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.359732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 805/1618] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:56 2022] PUT /identity/v3/projects/d871f345cb3b47ebbecf49bc9322298f/users/50e541707b4a4d9aa6c392fd93c2f872/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:56.365235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaebffc-2c70-46c0-a1c4-a3224dd77d24 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.374489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:56.397715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276bf74-7e13-4f37-94cf-f29ce1181971 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.426180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaebffc-2c70-46c0-a1c4-a3224dd77d24 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.431119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44b21-9de0-4e8b-9397-fbbd47737f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.431786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44b21-9de0-4e8b-9397-fbbd47737f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.432067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44b21-9de0-4e8b-9397-fbbd47737f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.432388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44b21-9de0-4e8b-9397-fbbd47737f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.433746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e44b21-9de0-4e8b-9397-fbbd47737f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.435686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e44b21-9de0-4e8b-9397-fbbd47737f8b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.453039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbb781-04ef-4c9f-9abc-a12564e4b222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.453685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbb781-04ef-4c9f-9abc-a12564e4b222 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.453972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbb781-04ef-4c9f-9abc-a12564e4b222 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.454250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbb781-04ef-4c9f-9abc-a12564e4b222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.468990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:56.513472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbb781-04ef-4c9f-9abc-a12564e4b222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.514893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbb781-04ef-4c9f-9abc-a12564e4b222 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.524136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 814/1619] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:56.525441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce691e-6633-4e28-b20c-f9abd908d4e9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.525928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce691e-6633-4e28-b20c-f9abd908d4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.526075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce691e-6633-4e28-b20c-f9abd908d4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.544245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9cce691e-6633-4e28-b20c-f9abd908d4e9 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:56.545614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9cce691e-6633-4e28-b20c-f9abd908d4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:56.554132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 815/1620] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:56.559010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce691e-6633-4e28-b20c-f9abd908d4e9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.566686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 806/1621] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:56 2022] POST /identity/v3/projects => generated 403 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:56.566686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44b21-9de0-4e8b-9397-fbbd47737f8b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.567070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce691e-6633-4e28-b20c-f9abd908d4e9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.644618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d153-2585-4f44-b348-6afc0ffbf4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.654249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d153-2585-4f44-b348-6afc0ffbf4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.654249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d153-2585-4f44-b348-6afc0ffbf4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.654249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d153-2585-4f44-b348-6afc0ffbf4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.654249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0d153-2585-4f44-b348-6afc0ffbf4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.654249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0d153-2585-4f44-b348-6afc0ffbf4bf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.668388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44b21-9de0-4e8b-9397-fbbd47737f8b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.674496 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e270b6-ccf3-4f4a-9249-2b3482a263bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.675206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e270b6-ccf3-4f4a-9249-2b3482a263bf service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.675493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e270b6-ccf3-4f4a-9249-2b3482a263bf service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.675771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e270b6-ccf3-4f4a-9249-2b3482a263bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.741228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 816/1622] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:56 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:56.742441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d153-2585-4f44-b348-6afc0ffbf4bf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.752237 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e270b6-ccf3-4f4a-9249-2b3482a263bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.754296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e270b6-ccf3-4f4a-9249-2b3482a263bf service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.765811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 807/1623] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:56.779270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e270b6-ccf3-4f4a-9249-2b3482a263bf service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.803751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e270b6-ccf3-4f4a-9249-2b3482a263bf service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.851683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d153-2585-4f44-b348-6afc0ffbf4bf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.857426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1a03c-1473-44d5-a6b9-5884e11ee7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.858096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1a03c-1473-44d5-a6b9-5884e11ee7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.858373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1a03c-1473-44d5-a6b9-5884e11ee7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.858640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1a03c-1473-44d5-a6b9-5884e11ee7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.860028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1a03c-1473-44d5-a6b9-5884e11ee7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.861681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1a03c-1473-44d5-a6b9-5884e11ee7ab admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.872718 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:56.873991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 817/1624] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:56.874831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1a03c-1473-44d5-a6b9-5884e11ee7ab admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.930858 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7760d3-d50d-4fed-88ba-5491dce021b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.931677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7760d3-d50d-4fed-88ba-5491dce021b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.932074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7760d3-d50d-4fed-88ba-5491dce021b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.932357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7760d3-d50d-4fed-88ba-5491dce021b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.933056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7760d3-d50d-4fed-88ba-5491dce021b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.937460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:56.948207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7760d3-d50d-4fed-88ba-5491dce021b2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.974092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1a03c-1473-44d5-a6b9-5884e11ee7ab admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.979555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886cacb-8009-4e4c-b532-9679de4b5375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.980936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886cacb-8009-4e4c-b532-9679de4b5375 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.981366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886cacb-8009-4e4c-b532-9679de4b5375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.981641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886cacb-8009-4e4c-b532-9679de4b5375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.991852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886cacb-8009-4e4c-b532-9679de4b5375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.993487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886cacb-8009-4e4c-b532-9679de4b5375 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.004536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 818/1625] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:57.006144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886cacb-8009-4e4c-b532-9679de4b5375 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.015512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886cacb-8009-4e4c-b532-9679de4b5375 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.021283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a5139-c57a-4b46-bfca-b5f6d51344d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.022132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a5139-c57a-4b46-bfca-b5f6d51344d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.022515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a5139-c57a-4b46-bfca-b5f6d51344d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.022854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a5139-c57a-4b46-bfca-b5f6d51344d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.024076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a5139-c57a-4b46-bfca-b5f6d51344d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.025775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a5139-c57a-4b46-bfca-b5f6d51344d4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.063746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 808/1626] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:56 2022] POST /identity/v3/users => generated 308 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:57.064556 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7760d3-d50d-4fed-88ba-5491dce021b2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.077053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7760d3-d50d-4fed-88ba-5491dce021b2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.081938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6779c7-e4dc-4fca-9853-d04939fe6094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.083524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6779c7-e4dc-4fca-9853-d04939fe6094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.085262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6779c7-e4dc-4fca-9853-d04939fe6094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.090008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6779c7-e4dc-4fca-9853-d04939fe6094 admin admin] PATH_INFO: `/v3/projects/d871f345cb3b47ebbecf49bc9322298f/users/50e541707b4a4d9aa6c392fd93c2f872/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.090008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6779c7-e4dc-4fca-9853-d04939fe6094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d871f345cb3b47ebbecf49bc9322298f, user_id=50e541707b4a4d9aa6c392fd93c2f872, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.090873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6779c7-e4dc-4fca-9853-d04939fe6094 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.109861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 809/1627] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:57 2022] PUT /identity/v3/projects/d871f345cb3b47ebbecf49bc9322298f/users/50e541707b4a4d9aa6c392fd93c2f872/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:57.111411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc015-972c-4e9c-a83a-be3413c95726 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.111699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc015-972c-4e9c-a83a-be3413c95726 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.111976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc015-972c-4e9c-a83a-be3413c95726 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.118402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 810/1628] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 2 10:12:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:12:57.120254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc015-972c-4e9c-a83a-be3413c95726 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.125508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 819/1629] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:57 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:57.126916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce518d-36c0-4eb1-ad4c-7e27fa4273a8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.127252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce518d-36c0-4eb1-ad4c-7e27fa4273a8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.127531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce518d-36c0-4eb1-ad4c-7e27fa4273a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.160298 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-49ce518d-36c0-4eb1-ad4c-7e27fa4273a8 None None] MFA Rules not processed for user `50e541707b4a4d9aa6c392fd93c2f872`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:57.164556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-49ce518d-36c0-4eb1-ad4c-7e27fa4273a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:57.211373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc015-972c-4e9c-a83a-be3413c95726 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.220662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658b797-e66d-4b52-8e76-3be7e9223ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.221849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658b797-e66d-4b52-8e76-3be7e9223ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.222403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658b797-e66d-4b52-8e76-3be7e9223ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.222848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658b797-e66d-4b52-8e76-3be7e9223ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.223854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658b797-e66d-4b52-8e76-3be7e9223ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.225468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658b797-e66d-4b52-8e76-3be7e9223ec9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.244539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 811/1630] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:57.246314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830513-b6f4-47b8-b6bb-a81c2e531404 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.246609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830513-b6f4-47b8-b6bb-a81c2e531404 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.246888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830513-b6f4-47b8-b6bb-a81c2e531404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.250744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 820/1631] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:57.256393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce518d-36c0-4eb1-ad4c-7e27fa4273a8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.282372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c1830513-b6f4-47b8-b6bb-a81c2e531404 None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:57.283658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c1830513-b6f4-47b8-b6bb-a81c2e531404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:57.289666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce518d-36c0-4eb1-ad4c-7e27fa4273a8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.298024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e8f4-4016-4087-93d3-2f05398465bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.298780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e8f4-4016-4087-93d3-2f05398465bb admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.299871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e8f4-4016-4087-93d3-2f05398465bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.300234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e8f4-4016-4087-93d3-2f05398465bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.300984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8e8f4-4016-4087-93d3-2f05398465bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.302807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8e8f4-4016-4087-93d3-2f05398465bb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.330891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 821/1632] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:57.333170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e8f4-4016-4087-93d3-2f05398465bb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.351966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e8f4-4016-4087-93d3-2f05398465bb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.361861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eb8a4-9287-4395-b74b-2dfc98347ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.364165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eb8a4-9287-4395-b74b-2dfc98347ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.364539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eb8a4-9287-4395-b74b-2dfc98347ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.365120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eb8a4-9287-4395-b74b-2dfc98347ac4 admin admin] PATH_INFO: `/v3/projects/0fec6da60a1244e5a63f09b2679407fa/users/dd62cfb36e0545349d10eb9977937b01/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.385856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2eb8a4-9287-4395-b74b-2dfc98347ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fec6da60a1244e5a63f09b2679407fa, user_id=dd62cfb36e0545349d10eb9977937b01, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.389439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2eb8a4-9287-4395-b74b-2dfc98347ac4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.400138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 812/1633] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:57.404539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830513-b6f4-47b8-b6bb-a81c2e531404 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.457069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:57.473727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830513-b6f4-47b8-b6bb-a81c2e531404 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.484587 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 822/1634] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:57 2022] PUT /identity/v3/projects/0fec6da60a1244e5a63f09b2679407fa/users/dd62cfb36e0545349d10eb9977937b01/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:57.485740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eb8a4-9287-4395-b74b-2dfc98347ac4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.486179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde001f5-3282-4e0a-8ba7-34a346eced56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.487700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde001f5-3282-4e0a-8ba7-34a346eced56 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.488505 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde001f5-3282-4e0a-8ba7-34a346eced56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.488919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde001f5-3282-4e0a-8ba7-34a346eced56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.500782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde001f5-3282-4e0a-8ba7-34a346eced56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.502327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde001f5-3282-4e0a-8ba7-34a346eced56 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.512627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 813/1635] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:57.515084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde001f5-3282-4e0a-8ba7-34a346eced56 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.525467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde001f5-3282-4e0a-8ba7-34a346eced56 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.553323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eb8a4-9287-4395-b74b-2dfc98347ac4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.558681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33334c73-f5ee-4004-a9ea-4a16edad4a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.559664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334c73-f5ee-4004-a9ea-4a16edad4a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.559944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334c73-f5ee-4004-a9ea-4a16edad4a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.560276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33334c73-f5ee-4004-a9ea-4a16edad4a1a admin admin] PATH_INFO: `/v3/projects/48883cc4e4074c60a0b80c03df63c7e1/users/dd68f40d8dc24682bd901e0ba606353d/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.601039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:57.607400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1eca8-217c-4c87-96dc-77c156d4d2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.608177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1eca8-217c-4c87-96dc-77c156d4d2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.608488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1eca8-217c-4c87-96dc-77c156d4d2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.608783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1eca8-217c-4c87-96dc-77c156d4d2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.609577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1eca8-217c-4c87-96dc-77c156d4d2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.611337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1eca8-217c-4c87-96dc-77c156d4d2a1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.611702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33334c73-f5ee-4004-a9ea-4a16edad4a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48883cc4e4074c60a0b80c03df63c7e1, user_id=dd68f40d8dc24682bd901e0ba606353d, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.615645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33334c73-f5ee-4004-a9ea-4a16edad4a1a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.627030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 814/1636] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:57.627030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1eca8-217c-4c87-96dc-77c156d4d2a1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.698118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1eca8-217c-4c87-96dc-77c156d4d2a1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.728722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2af67-cb81-4aac-ae82-bf568481eb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.730120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2af67-cb81-4aac-ae82-bf568481eb56 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.730751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2af67-cb81-4aac-ae82-bf568481eb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.731038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2af67-cb81-4aac-ae82-bf568481eb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.742703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 823/1637] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:57 2022] PUT /identity/v3/projects/48883cc4e4074c60a0b80c03df63c7e1/users/dd68f40d8dc24682bd901e0ba606353d/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:57.744801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33334c73-f5ee-4004-a9ea-4a16edad4a1a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.849008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33334c73-f5ee-4004-a9ea-4a16edad4a1a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:57.854484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870885c-f2c4-41dc-868c-d9bf5f61092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:57.855528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870885c-f2c4-41dc-868c-d9bf5f61092f admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.855903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870885c-f2c4-41dc-868c-d9bf5f61092f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.856455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870885c-f2c4-41dc-868c-d9bf5f61092f admin admin] PATH_INFO: `/v3/projects/0fec6da60a1244e5a63f09b2679407fa/users/dd62cfb36e0545349d10eb9977937b01/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.858574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870885c-f2c4-41dc-868c-d9bf5f61092f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fec6da60a1244e5a63f09b2679407fa, user_id=dd62cfb36e0545349d10eb9977937b01, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.861428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870885c-f2c4-41dc-868c-d9bf5f61092f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.872976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2af67-cb81-4aac-ae82-bf568481eb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:57.874612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2af67-cb81-4aac-ae82-bf568481eb56 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.878707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 824/1638] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:57 2022] PUT /identity/v3/projects/0fec6da60a1244e5a63f09b2679407fa/users/dd62cfb36e0545349d10eb9977937b01/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:57.879938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870885c-f2c4-41dc-868c-d9bf5f61092f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.908381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 815/1639] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:57.909780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d4cc4-b724-4aeb-937e-16b3de9436f9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.911737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d4cc4-b724-4aeb-937e-16b3de9436f9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.912056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d4cc4-b724-4aeb-937e-16b3de9436f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.948151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-425d4cc4-b724-4aeb-937e-16b3de9436f9 None None] MFA Rules not processed for user `dd62cfb36e0545349d10eb9977937b01`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:57.949926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-425d4cc4-b724-4aeb-937e-16b3de9436f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:57.956104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:58.008131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870885c-f2c4-41dc-868c-d9bf5f61092f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:58.013326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0201f04-7639-49b8-9cde-955a2bb6a7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:58.013833 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0201f04-7639-49b8-9cde-955a2bb6a7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.014163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0201f04-7639-49b8-9cde-955a2bb6a7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.014442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0201f04-7639-49b8-9cde-955a2bb6a7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.015203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0201f04-7639-49b8-9cde-955a2bb6a7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:58.016955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0201f04-7639-49b8-9cde-955a2bb6a7a4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:58.049177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 816/1640] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:58.049177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d4cc4-b724-4aeb-937e-16b3de9436f9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:58.054080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 825/1641] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:58.062359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0201f04-7639-49b8-9cde-955a2bb6a7a4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:58.081610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0201f04-7639-49b8-9cde-955a2bb6a7a4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:58.104031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fdc29-a4a2-464b-80fd-d386da34173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:58.116940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fdc29-a4a2-464b-80fd-d386da34173f admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.117403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fdc29-a4a2-464b-80fd-d386da34173f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.117623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fdc29-a4a2-464b-80fd-d386da34173f admin admin] PATH_INFO: `/v3/projects/48883cc4e4074c60a0b80c03df63c7e1/users/dd68f40d8dc24682bd901e0ba606353d/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.122819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fdc29-a4a2-464b-80fd-d386da34173f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48883cc4e4074c60a0b80c03df63c7e1, user_id=dd68f40d8dc24682bd901e0ba606353d, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:58.125596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fdc29-a4a2-464b-80fd-d386da34173f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:58.148146 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d4cc4-b724-4aeb-937e-16b3de9436f9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:58.169327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 826/1642] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:58 2022] PUT /identity/v3/projects/48883cc4e4074c60a0b80c03df63c7e1/users/dd68f40d8dc24682bd901e0ba606353d/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:58.169327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f8ae7-ba30-45ed-886b-434b4eabfa7c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.169327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f8ae7-ba30-45ed-886b-434b4eabfa7c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.169327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f8ae7-ba30-45ed-886b-434b4eabfa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.208994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fb0f8ae7-ba30-45ed-886b-434b4eabfa7c None None] MFA Rules not processed for user `aea254e4bdc142b9ae1767335fd84d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:58.210240 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fb0f8ae7-ba30-45ed-886b-434b4eabfa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:58.246962 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5342b-113d-4a42-8c1e-e1f9ecec7ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:58.247910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5342b-113d-4a42-8c1e-e1f9ecec7ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.248303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5342b-113d-4a42-8c1e-e1f9ecec7ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.248685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5342b-113d-4a42-8c1e-e1f9ecec7ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.320182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:58.340065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 827/1643] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:58.344279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b48f7-2e3f-426e-8c6f-62e1741802e3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.344789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b48f7-2e3f-426e-8c6f-62e1741802e3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.345821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b48f7-2e3f-426e-8c6f-62e1741802e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.392871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5342b-113d-4a42-8c1e-e1f9ecec7ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:58.394332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5342b-113d-4a42-8c1e-e1f9ecec7ac8 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:58.416261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 817/1644] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:58.420472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c773c7-7cc4-4330-a1b0-f4537ec4d4dd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.420763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c773c7-7cc4-4330-a1b0-f4537ec4d4dd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.421044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c773c7-7cc4-4330-a1b0-f4537ec4d4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.422470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ea7b48f7-2e3f-426e-8c6f-62e1741802e3 None None] MFA Rules not processed for user `dd68f40d8dc24682bd901e0ba606353d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:58.423942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ea7b48f7-2e3f-426e-8c6f-62e1741802e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:58.462576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-42c773c7-7cc4-4330-a1b0-f4537ec4d4dd None None] MFA Rules not processed for user `aea254e4bdc142b9ae1767335fd84d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:58.463918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-42c773c7-7cc4-4330-a1b0-f4537ec4d4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:58.485005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 818/1645] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:58.523742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf5ed9-d2ea-45a6-a779-cd7ed3e793d2 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.524090 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf5ed9-d2ea-45a6-a779-cd7ed3e793d2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.524378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf5ed9-d2ea-45a6-a779-cd7ed3e793d2 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.526469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 819/1646] 10.222.0.13 () {54 vars in 961 bytes} [Thu Jun 2 10:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:12:58.551006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb4a8-5c43-4f63-8611-5c45d580f6f5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.551006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb4a8-5c43-4f63-8611-5c45d580f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.551006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb4a8-5c43-4f63-8611-5c45d580f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.566991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:58.584288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-370cb4a8-5c43-4f63-8611-5c45d580f6f5 None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:58.585625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-370cb4a8-5c43-4f63-8611-5c45d580f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:58.592103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 828/1647] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:12:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:58.676448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 820/1648] 10.222.0.13 () {58 vars in 1058 bytes} [Thu Jun 2 10:12:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:58.685144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b48f7-2e3f-426e-8c6f-62e1741802e3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:58.699153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b48f7-2e3f-426e-8c6f-62e1741802e3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:58.721603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f25edb-b917-492a-95bf-ccdc76985d06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:58.722655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f25edb-b917-492a-95bf-ccdc76985d06 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.723659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f25edb-b917-492a-95bf-ccdc76985d06 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.723779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f25edb-b917-492a-95bf-ccdc76985d06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.733528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f25edb-b917-492a-95bf-ccdc76985d06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:58.735190 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f25edb-b917-492a-95bf-ccdc76985d06 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:58.748722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 829/1649] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:58.841342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb4a8-5c43-4f63-8611-5c45d580f6f5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:58.854465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb4a8-5c43-4f63-8611-5c45d580f6f5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:58.860798 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142776ed-e97a-48ff-bcc1-bfe349fa989b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:58.861912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142776ed-e97a-48ff-bcc1-bfe349fa989b service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.862886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142776ed-e97a-48ff-bcc1-bfe349fa989b service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.863393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142776ed-e97a-48ff-bcc1-bfe349fa989b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.955866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142776ed-e97a-48ff-bcc1-bfe349fa989b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:58.957797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142776ed-e97a-48ff-bcc1-bfe349fa989b service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:58.985101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 821/1650] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:12:59.061993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142776ed-e97a-48ff-bcc1-bfe349fa989b service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:59.062961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fa3bb-d009-4d0f-ad2e-af811f9c67d5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.063471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fa3bb-d009-4d0f-ad2e-af811f9c67d5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.063726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fa3bb-d009-4d0f-ad2e-af811f9c67d5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.065381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 830/1651] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 2 10:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:12:59.072963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142776ed-e97a-48ff-bcc1-bfe349fa989b service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:59.078542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515654c-c743-4402-a70b-f03c30050008 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.078835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515654c-c743-4402-a70b-f03c30050008 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.079152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515654c-c743-4402-a70b-f03c30050008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.079782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db4bd0-8c63-4e71-a42e-3cc9493e21dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:59.080605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db4bd0-8c63-4e71-a42e-3cc9493e21dd service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.081047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db4bd0-8c63-4e71-a42e-3cc9493e21dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.081471 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db4bd0-8c63-4e71-a42e-3cc9493e21dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.092826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db4bd0-8c63-4e71-a42e-3cc9493e21dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:59.095458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db4bd0-8c63-4e71-a42e-3cc9493e21dd service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:59.106507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a515654c-c743-4402-a70b-f03c30050008 None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:59.107784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a515654c-c743-4402-a70b-f03c30050008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:59.111493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 822/1652] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:59.120356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 831/1653] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:12:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:59.143467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db4bd0-8c63-4e71-a42e-3cc9493e21dd service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:59.147020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-09db4bd0-8c63-4e71-a42e-3cc9493e21dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:59.252119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db4bd0-8c63-4e71-a42e-3cc9493e21dd service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:59.260678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3779ff-d228-4383-8544-620fff2d4353 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbc657ed3ae49dc9d45687c5dde2ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:59.263413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3779ff-d228-4383-8544-620fff2d4353 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.263413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3779ff-d228-4383-8544-620fff2d4353 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.263650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3779ff-d228-4383-8544-620fff2d4353 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.291547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3779ff-d228-4383-8544-620fff2d4353 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:59.298654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3779ff-d228-4383-8544-620fff2d4353 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:59.317099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 823/1654] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:59.711603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515654c-c743-4402-a70b-f03c30050008 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:59.711603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515654c-c743-4402-a70b-f03c30050008 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:59.711603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:59.711603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.751465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.751465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] PATH_INFO: `/v3/users/36fe013401be4085aa5ba0473dae000b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.751465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fe013401be4085aa5ba0473dae000b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:59.751465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: WARNING py.warnings [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:59.751465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: warnings.warn(msg) Jun 02 10:12:59.751465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: Jun 02 10:12:59.751465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:59.897686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ab88b-f4fb-48a3-8209-59d2c2fd4b14 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.898003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ab88b-f4fb-48a3-8209-59d2c2fd4b14 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.898277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ab88b-f4fb-48a3-8209-59d2c2fd4b14 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.899844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 824/1655] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 2 10:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:12:59.905300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb1b8-8f9a-4d60-86b7-e87c88f12f26 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.905576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb1b8-8f9a-4d60-86b7-e87c88f12f26 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.905847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bb1b8-8f9a-4d60-86b7-e87c88f12f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.924363 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0a8bb1b8-8f9a-4d60-86b7-e87c88f12f26 None None] MFA Rules not processed for user `4bc0ef455caa4ee5b6b86dc1904d4e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:59.925566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0a8bb1b8-8f9a-4d60-86b7-e87c88f12f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:59.945405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:59.977327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 825/1656] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:12:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:59.990886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb1b8-8f9a-4d60-86b7-e87c88f12f26 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:59.999759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bb1b8-8f9a-4d60-86b7-e87c88f12f26 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:00.003450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316dea5-053d-431e-9799-0d459b94c2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:00.004033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316dea5-053d-431e-9799-0d459b94c2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.004319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316dea5-053d-431e-9799-0d459b94c2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.004599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316dea5-053d-431e-9799-0d459b94c2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.015507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316dea5-053d-431e-9799-0d459b94c2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:00.017166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316dea5-053d-431e-9799-0d459b94c2c3 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:00.032593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 826/1657] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:00.094972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fe013401be4085aa5ba0473dae000b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:00.096277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fe013401be4085aa5ba0473dae000b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:00.097338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fe013401be4085aa5ba0473dae000b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:00.129737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fe013401be4085aa5ba0473dae000b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:00.143390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fe013401be4085aa5ba0473dae000b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:00.248146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 832/1658] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:12:59 2022] DELETE /identity/v3/users/36fe013401be4085aa5ba0473dae000b => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:00.252414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3034b-4bf6-41de-aa35-744405e4fb9f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.253381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3034b-4bf6-41de-aa35-744405e4fb9f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.255840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3034b-4bf6-41de-aa35-744405e4fb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.281332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:00.284529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d9f3034b-4bf6-41de-aa35-744405e4fb9f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:00.286244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d9f3034b-4bf6-41de-aa35-744405e4fb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:00.412304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 827/1659] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:00.484130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:00.486015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:00.597612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f77823-5136-40e9-ad63-785ed562a911 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:00.605035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6edbe3-118b-4bd0-b721-1fd8f85d8fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:00.606028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6edbe3-118b-4bd0-b721-1fd8f85d8fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.606676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6edbe3-118b-4bd0-b721-1fd8f85d8fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.607193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6edbe3-118b-4bd0-b721-1fd8f85d8fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.631994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6edbe3-118b-4bd0-b721-1fd8f85d8fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:00.634494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6edbe3-118b-4bd0-b721-1fd8f85d8fe3 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:00.655794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 833/1660] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:01.136904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194cf3-1047-401d-b862-08658b154d79 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.137188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194cf3-1047-401d-b862-08658b154d79 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.137627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194cf3-1047-401d-b862-08658b154d79 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.139013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 828/1661] 10.222.0.13 () {54 vars in 960 bytes} [Thu Jun 2 10:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:01.149817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e413a-643a-4189-9908-21208a8be2a9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.153542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e413a-643a-4189-9908-21208a8be2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.153542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e413a-643a-4189-9908-21208a8be2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.206904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-698e413a-643a-4189-9908-21208a8be2a9 None None] MFA Rules not processed for user `bef7eacc5dc0445fa3297db10c8b4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:01.210849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-698e413a-643a-4189-9908-21208a8be2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:01.410410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 834/1662] 10.222.0.13 () {58 vars in 1057 bytes} [Thu Jun 2 10:13:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:01.426195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b194cf3-1047-401d-b862-08658b154d79 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:01.470073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b194cf3-1047-401d-b862-08658b154d79 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:01.492441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:01.493142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.493380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.493664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.511010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:01.548523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:01.549641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:01.589107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 829/1663] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:01.877659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e413a-643a-4189-9908-21208a8be2a9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:01.879127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-698e413a-643a-4189-9908-21208a8be2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:01.905246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e413a-643a-4189-9908-21208a8be2a9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:01.917677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:01.918751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.919021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.919391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] PATH_INFO: `/v3/projects/0a2004683a1943e4b8b60aba677c09c5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.920978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2004683a1943e4b8b60aba677c09c5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:01.925852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:02.154840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2004683a1943e4b8b60aba677c09c5', 'request_id': 'req-acdb08bd-3608-4047-909a-9a00e3f9bf67'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.167988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2004683a1943e4b8b60aba677c09c5', 'request_id': 'req-acdb08bd-3608-4047-909a-9a00e3f9bf67'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.262019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2004683a1943e4b8b60aba677c09c5', 'request_id': 'req-acdb08bd-3608-4047-909a-9a00e3f9bf67'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.268571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:02.270796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:02.287049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] The token cache is being invalidate because project 0a2004683a1943e4b8b60aba677c09c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:02.288635 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.291140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.297344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 835/1664] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:01 2022] DELETE /identity/v3/projects/0a2004683a1943e4b8b60aba677c09c5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:02.298263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:02.301233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:02.315241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:02.318533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfedf4-8b91-40f0-bea0-d96b831a0443 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:02.433794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb08bd-3608-4047-909a-9a00e3f9bf67 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:02.444957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:02.446194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:02.446576 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:02.447444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] PATH_INFO: `/v3/users/dd62cfb36e0545349d10eb9977937b01` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:02.447720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:02.449454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd62cfb36e0545349d10eb9977937b01)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:02.451592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:02.451700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:02.452043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:02.452326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] PATH_INFO: `/v3/users/f364bffaa2674cf9b8390b40195312de` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:02.454577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f364bffaa2674cf9b8390b40195312de)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:02.460614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:02.714827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd62cfb36e0545349d10eb9977937b01'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.715770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd62cfb36e0545349d10eb9977937b01'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.716521 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd62cfb36e0545349d10eb9977937b01'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.735010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd62cfb36e0545349d10eb9977937b01'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.745090 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7bd02a31-a298-47c8-9bc7-75004036fe69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd62cfb36e0545349d10eb9977937b01'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.760215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f364bffaa2674cf9b8390b40195312de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.761275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f364bffaa2674cf9b8390b40195312de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.768812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:02.811076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f364bffaa2674cf9b8390b40195312de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.838302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f364bffaa2674cf9b8390b40195312de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.842062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f364bffaa2674cf9b8390b40195312de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.851663 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 836/1665] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:02 2022] DELETE /identity/v3/users/dd62cfb36e0545349d10eb9977937b01 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:03.008702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 830/1666] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:02 2022] DELETE /identity/v3/users/f364bffaa2674cf9b8390b40195312de => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:03.013856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d168c6-66d3-4891-aae7-cd8109b91a90 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.017303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d168c6-66d3-4891-aae7-cd8109b91a90 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.017770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d168c6-66d3-4891-aae7-cd8109b91a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.091736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-85d168c6-66d3-4891-aae7-cd8109b91a90 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:03.095369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-85d168c6-66d3-4891-aae7-cd8109b91a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:03.274858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 837/1667] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:03.393032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:03.394652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:03.396477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d168c6-66d3-4891-aae7-cd8109b91a90 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:03.398433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-85d168c6-66d3-4891-aae7-cd8109b91a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:03.417603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eace0d8-dfd0-4dc9-bf2c-07188b3ef621 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:03.432561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:03.433807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.446038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.446038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] PATH_INFO: `/v3/users/20cbad694976400f94f2d0e6a63cdb98` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.446038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20cbad694976400f94f2d0e6a63cdb98)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:03.446038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:03.507113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d168c6-66d3-4891-aae7-cd8109b91a90 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:03.512009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a854e-74b3-4578-afd0-f8342af9e922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:03.512678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a854e-74b3-4578-afd0-f8342af9e922 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.512966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a854e-74b3-4578-afd0-f8342af9e922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.513242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a854e-74b3-4578-afd0-f8342af9e922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.526510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a854e-74b3-4578-afd0-f8342af9e922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:03.529087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a854e-74b3-4578-afd0-f8342af9e922 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:03.544572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 838/1668] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:03.746714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20cbad694976400f94f2d0e6a63cdb98'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:03.748039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20cbad694976400f94f2d0e6a63cdb98'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:03.778025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20cbad694976400f94f2d0e6a63cdb98'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:03.791755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20cbad694976400f94f2d0e6a63cdb98'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:03.793202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20cbad694976400f94f2d0e6a63cdb98'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:03.881014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 831/1669] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:03 2022] DELETE /identity/v3/users/20cbad694976400f94f2d0e6a63cdb98 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:03.886745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd76e3-d4ad-4f19-b0a0-d9d4498e1f7c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.887030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd76e3-d4ad-4f19-b0a0-d9d4498e1f7c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.887336 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd76e3-d4ad-4f19-b0a0-d9d4498e1f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.915753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1ffd76e3-d4ad-4f19-b0a0-d9d4498e1f7c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:03.917139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1ffd76e3-d4ad-4f19-b0a0-d9d4498e1f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:03.989165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 839/1670] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:04.038921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:04.042002 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:04.220263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6abd74-0c0b-45ca-9b80-c863b480caf8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:04.227328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ec360-caa1-4f6c-83b6-d598276aa4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:04.229547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ec360-caa1-4f6c-83b6-d598276aa4ea service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:04.233117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ec360-caa1-4f6c-83b6-d598276aa4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:04.234978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ec360-caa1-4f6c-83b6-d598276aa4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:04.247913 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ec360-caa1-4f6c-83b6-d598276aa4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:04.249467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ec360-caa1-4f6c-83b6-d598276aa4ea service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:04.261604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 832/1671] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:04.695180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd76e3-d4ad-4f19-b0a0-d9d4498e1f7c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:04.696892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1ffd76e3-d4ad-4f19-b0a0-d9d4498e1f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:04.709049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ec360-caa1-4f6c-83b6-d598276aa4ea service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:04.710462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a82ec360-caa1-4f6c-83b6-d598276aa4ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:04.731196 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd76e3-d4ad-4f19-b0a0-d9d4498e1f7c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:04.737187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ec360-caa1-4f6c-83b6-d598276aa4ea service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:04.753431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:04.756763 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:04.767778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:04.768470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:04.768470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] PATH_INFO: `/v3/projects/b9440ff46d69454eba60eec875d91c43` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:04.768470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9440ff46d69454eba60eec875d91c43)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:04.768819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:04.768819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:04.768819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] PATH_INFO: `/v3/projects/0fec6da60a1244e5a63f09b2679407fa` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:04.768819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fec6da60a1244e5a63f09b2679407fa)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:04.768819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: WARNING py.warnings [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:13:04.768819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: warnings.warn(msg) Jun 02 10:13:04.768819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: Jun 02 10:13:04.769179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:04.769565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:04.949612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9440ff46d69454eba60eec875d91c43', 'request_id': 'req-8155ca62-e094-4786-bb7f-d7e1e4fef796'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:04.967812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9440ff46d69454eba60eec875d91c43', 'request_id': 'req-8155ca62-e094-4786-bb7f-d7e1e4fef796'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:04.983705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:05.018201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fec6da60a1244e5a63f09b2679407fa', 'request_id': 'req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.035755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:05.052947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fec6da60a1244e5a63f09b2679407fa', 'request_id': 'req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.078403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9440ff46d69454eba60eec875d91c43', 'request_id': 'req-8155ca62-e094-4786-bb7f-d7e1e4fef796'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.098650 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] The token cache is being invalidate because project b9440ff46d69454eba60eec875d91c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:05.099634 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.105765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.107874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 840/1672] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:04 2022] DELETE /identity/v3/projects/b9440ff46d69454eba60eec875d91c43 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:05.111777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:05.115062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:05.155125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fec6da60a1244e5a63f09b2679407fa', 'request_id': 'req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.181596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] The token cache is being invalidate because project 0fec6da60a1244e5a63f09b2679407fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:05.181883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.192920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ca3d1c7b-a3e7-4df8-9327-0f5a4b0ac21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.196777 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 833/1673] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:04 2022] DELETE /identity/v3/projects/0fec6da60a1244e5a63f09b2679407fa => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:05.203170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4c071-1f61-4fab-9bc4-12c5559a39ad None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:05.203512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4c071-1f61-4fab-9bc4-12c5559a39ad None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:05.208799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4c071-1f61-4fab-9bc4-12c5559a39ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:05.235480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-92b4c071-1f61-4fab-9bc4-12c5559a39ad None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:05.236968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-92b4c071-1f61-4fab-9bc4-12c5559a39ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:05.308132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155ca62-e094-4786-bb7f-d7e1e4fef796 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:05.415514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 834/1674] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:05.420039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba7ae2-0c6f-4ca9-98dc-60e973f247ba None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:05.421601 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba7ae2-0c6f-4ca9-98dc-60e973f247ba None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:05.421953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba7ae2-0c6f-4ca9-98dc-60e973f247ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:05.454431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-acba7ae2-0c6f-4ca9-98dc-60e973f247ba None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:05.458719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-acba7ae2-0c6f-4ca9-98dc-60e973f247ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:05.486717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 835/1675] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:05.486717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba7ae2-0c6f-4ca9-98dc-60e973f247ba None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:05.489559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:05.490459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:05.490739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:05.490947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-acba7ae2-0c6f-4ca9-98dc-60e973f247ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:05.491041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] PATH_INFO: `/v3/users/dd68f40d8dc24682bd901e0ba606353d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:05.492387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd68f40d8dc24682bd901e0ba606353d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:05.494323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:05.523222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba7ae2-0c6f-4ca9-98dc-60e973f247ba None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:05.536197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:05.537938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:05.537938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:05.537938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] PATH_INFO: `/v3/projects/6beed4978c174ffe81c6ee8ea79ae7f3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:05.541056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6beed4978c174ffe81c6ee8ea79ae7f3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:05.549191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:05.765237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd68f40d8dc24682bd901e0ba606353d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.766140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd68f40d8dc24682bd901e0ba606353d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.767286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd68f40d8dc24682bd901e0ba606353d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.775315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6beed4978c174ffe81c6ee8ea79ae7f3', 'request_id': 'req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.789605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd68f40d8dc24682bd901e0ba606353d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.793384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6beed4978c174ffe81c6ee8ea79ae7f3', 'request_id': 'req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.804021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-83041396-f2b9-4557-9587-ac12f3df750b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd68f40d8dc24682bd901e0ba606353d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.886359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6beed4978c174ffe81c6ee8ea79ae7f3', 'request_id': 'req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.897969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] The token cache is being invalidate because project 6beed4978c174ffe81c6ee8ea79ae7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:05.898264 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.899076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.900994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 836/1676] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:05 2022] DELETE /identity/v3/projects/6beed4978c174ffe81c6ee8ea79ae7f3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:05.902163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:05.903589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:06.011174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6026b-5f3c-48f6-bcee-392fa4a1673f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:06.012586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 841/1677] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:05 2022] DELETE /identity/v3/users/dd68f40d8dc24682bd901e0ba606353d => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:06.013969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40eb17-44a2-413b-94af-b1276d6c9aef None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.014411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40eb17-44a2-413b-94af-b1276d6c9aef None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.014825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40eb17-44a2-413b-94af-b1276d6c9aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.063641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3a40eb17-44a2-413b-94af-b1276d6c9aef None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:06.065374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3a40eb17-44a2-413b-94af-b1276d6c9aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:06.093759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eda6d-3afc-4af7-ab98-a06085a58a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:06.094545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eda6d-3afc-4af7-ab98-a06085a58a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.095300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eda6d-3afc-4af7-ab98-a06085a58a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.095661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eda6d-3afc-4af7-ab98-a06085a58a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.096929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eda6d-3afc-4af7-ab98-a06085a58a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:06.097448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eda6d-3afc-4af7-ab98-a06085a58a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:06.099402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eda6d-3afc-4af7-ab98-a06085a58a53 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:06.123407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 837/1678] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:06.123407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eda6d-3afc-4af7-ab98-a06085a58a53 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:06.139352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eda6d-3afc-4af7-ab98-a06085a58a53 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:06.161701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bc637-1e3f-43d5-8b56-d14577d80e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:06.163038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bc637-1e3f-43d5-8b56-d14577d80e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.163352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bc637-1e3f-43d5-8b56-d14577d80e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.163628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bc637-1e3f-43d5-8b56-d14577d80e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.165161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bc637-1e3f-43d5-8b56-d14577d80e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:06.168875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bc637-1e3f-43d5-8b56-d14577d80e32 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:06.253502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 842/1679] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:06.267408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174abff5-dba4-4d8a-9069-3d76c776cbea None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.269335 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174abff5-dba4-4d8a-9069-3d76c776cbea None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.269830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174abff5-dba4-4d8a-9069-3d76c776cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.315319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-174abff5-dba4-4d8a-9069-3d76c776cbea None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:06.316994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-174abff5-dba4-4d8a-9069-3d76c776cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:06.323147 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 838/1680] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:06 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:06.329193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bc637-1e3f-43d5-8b56-d14577d80e32 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:06.332509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 843/1681] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:06.337236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174abff5-dba4-4d8a-9069-3d76c776cbea None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:06.359838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174abff5-dba4-4d8a-9069-3d76c776cbea None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:06.521591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bc637-1e3f-43d5-8b56-d14577d80e32 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:06.530198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc1949-052e-4b4f-87b4-a49042bab302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:06.531206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc1949-052e-4b4f-87b4-a49042bab302 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.531699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc1949-052e-4b4f-87b4-a49042bab302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.532240 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc1949-052e-4b4f-87b4-a49042bab302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.533983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc1949-052e-4b4f-87b4-a49042bab302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:06.534549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc1949-052e-4b4f-87b4-a49042bab302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:06.535479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714de267-cbc7-43cd-b7ad-1a52faf8bc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:06.536334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714de267-cbc7-43cd-b7ad-1a52faf8bc64 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.536711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714de267-cbc7-43cd-b7ad-1a52faf8bc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.536998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714de267-cbc7-43cd-b7ad-1a52faf8bc64 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.537777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc1949-052e-4b4f-87b4-a49042bab302 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:06.539871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714de267-cbc7-43cd-b7ad-1a52faf8bc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:06.542357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714de267-cbc7-43cd-b7ad-1a52faf8bc64 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:06.555314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 844/1682] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:06.561882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc1949-052e-4b4f-87b4-a49042bab302 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:06.582184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc1949-052e-4b4f-87b4-a49042bab302 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:06.590153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be4101-026f-4ff2-9e28-7b4808e0e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:06.590965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be4101-026f-4ff2-9e28-7b4808e0e615 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.591830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be4101-026f-4ff2-9e28-7b4808e0e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.592224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be4101-026f-4ff2-9e28-7b4808e0e615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.593007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be4101-026f-4ff2-9e28-7b4808e0e615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:06.596032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be4101-026f-4ff2-9e28-7b4808e0e615 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:06.671875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 839/1683] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:06 2022] POST /identity/v3/users => generated 284 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:06.673234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f0b59-7ecb-470b-9443-6dfcdee5634c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.673568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f0b59-7ecb-470b-9443-6dfcdee5634c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.673850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f0b59-7ecb-470b-9443-6dfcdee5634c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.714007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-352f0b59-7ecb-470b-9443-6dfcdee5634c None None] MFA Rules not processed for user `a696d00855ef439c9d80b6bec5312f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:06.716048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-352f0b59-7ecb-470b-9443-6dfcdee5634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:06.722711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 845/1684] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:06 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:06.723952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be4101-026f-4ff2-9e28-7b4808e0e615 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:06.814800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be4101-026f-4ff2-9e28-7b4808e0e615 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:06.817571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 840/1685] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:06.819316 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f0b59-7ecb-470b-9443-6dfcdee5634c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:06.819890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd201ecb-b877-4fca-839c-53c87f20e836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:06.820580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd201ecb-b877-4fca-839c-53c87f20e836 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.820872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd201ecb-b877-4fca-839c-53c87f20e836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.821148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd201ecb-b877-4fca-839c-53c87f20e836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.821883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd201ecb-b877-4fca-839c-53c87f20e836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:06.824689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd201ecb-b877-4fca-839c-53c87f20e836 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:06.840595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 846/1686] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:06.840595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8169d0-aaeb-41d3-aea3-69c5521f2133 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.840595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8169d0-aaeb-41d3-aea3-69c5521f2133 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.840595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8169d0-aaeb-41d3-aea3-69c5521f2133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.843045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f0b59-7ecb-470b-9443-6dfcdee5634c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:06.853919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86a59c-205a-4737-8c71-0e77c758347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:06.854617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86a59c-205a-4737-8c71-0e77c758347a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.854928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86a59c-205a-4737-8c71-0e77c758347a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.855244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86a59c-205a-4737-8c71-0e77c758347a admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.857214 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86a59c-205a-4737-8c71-0e77c758347a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:06.859177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86a59c-205a-4737-8c71-0e77c758347a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:06.890855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fa8169d0-aaeb-41d3-aea3-69c5521f2133 None None] MFA Rules not processed for user `a696d00855ef439c9d80b6bec5312f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:06.890855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa8169d0-aaeb-41d3-aea3-69c5521f2133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:06.958678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 841/1687] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:06 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:06.959860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86a59c-205a-4737-8c71-0e77c758347a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:06.983464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86a59c-205a-4737-8c71-0e77c758347a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:06.997103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc55b4-bc0e-4a23-a556-03c3df0a00fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:06.997783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc55b4-bc0e-4a23-a556-03c3df0a00fb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.998056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc55b4-bc0e-4a23-a556-03c3df0a00fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.998333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc55b4-bc0e-4a23-a556-03c3df0a00fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.999059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc55b4-bc0e-4a23-a556-03c3df0a00fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:07.002585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc55b4-bc0e-4a23-a556-03c3df0a00fb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:07.016400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 847/1688] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:07.017421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8169d0-aaeb-41d3-aea3-69c5521f2133 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:07.033253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8169d0-aaeb-41d3-aea3-69c5521f2133 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:07.036824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 842/1689] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:07.037966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc55b4-bc0e-4a23-a556-03c3df0a00fb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:07.040057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-79cc55b4-bc0e-4a23-a556-03c3df0a00fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:07.043374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82259f5-d0e0-48cb-92dd-45490e3de788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:07.043374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82259f5-d0e0-48cb-92dd-45490e3de788 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.043848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82259f5-d0e0-48cb-92dd-45490e3de788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.044219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82259f5-d0e0-48cb-92dd-45490e3de788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.045010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82259f5-d0e0-48cb-92dd-45490e3de788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:07.051080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82259f5-d0e0-48cb-92dd-45490e3de788 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:07.081324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 848/1690] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:07.082559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82259f5-d0e0-48cb-92dd-45490e3de788 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:07.106411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82259f5-d0e0-48cb-92dd-45490e3de788 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:07.118782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8144ae-6b79-4944-bed9-779bb708ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:07.119415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8144ae-6b79-4944-bed9-779bb708ddfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.119697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8144ae-6b79-4944-bed9-779bb708ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.119973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8144ae-6b79-4944-bed9-779bb708ddfe admin admin] PATH_INFO: `/v3/projects/96511f46a66d470e84fc69a52b3c8ab7/users/0f2e39e6571b414084ecb3ed71d8e682/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.146275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8144ae-6b79-4944-bed9-779bb708ddfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=96511f46a66d470e84fc69a52b3c8ab7, user_id=0f2e39e6571b414084ecb3ed71d8e682, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:07.148885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8144ae-6b79-4944-bed9-779bb708ddfe admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:07.199345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc55b4-bc0e-4a23-a556-03c3df0a00fb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:07.205693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7558cf-79a2-4a30-8395-8744fa9376fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:07.206484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7558cf-79a2-4a30-8395-8744fa9376fe service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.206660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7558cf-79a2-4a30-8395-8744fa9376fe service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.206913 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7558cf-79a2-4a30-8395-8744fa9376fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.216370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7558cf-79a2-4a30-8395-8744fa9376fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:07.218177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7558cf-79a2-4a30-8395-8744fa9376fe service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:07.230975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 843/1691] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:07.230975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7558cf-79a2-4a30-8395-8744fa9376fe service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:07.242918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7558cf-79a2-4a30-8395-8744fa9376fe service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:07.250275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:07.252408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4b535-1e09-4ac4-a473-b7612dc78d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:07.254721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4b535-1e09-4ac4-a473-b7612dc78d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.254721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4b535-1e09-4ac4-a473-b7612dc78d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.260799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4b535-1e09-4ac4-a473-b7612dc78d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.266288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4b535-1e09-4ac4-a473-b7612dc78d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:07.268492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4b535-1e09-4ac4-a473-b7612dc78d01 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:07.300776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 844/1692] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:07.301814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4b535-1e09-4ac4-a473-b7612dc78d01 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:07.303516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 849/1693] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:07 2022] PUT /identity/v3/projects/96511f46a66d470e84fc69a52b3c8ab7/users/0f2e39e6571b414084ecb3ed71d8e682/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:07.304211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9fd4b535-1e09-4ac4-a473-b7612dc78d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:07.306273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:07.314464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8144ae-6b79-4944-bed9-779bb708ddfe admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:07.322906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4b535-1e09-4ac4-a473-b7612dc78d01 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:07.463782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:07.465191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.465476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.465750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] PATH_INFO: `/v3/projects/48883cc4e4074c60a0b80c03df63c7e1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.468050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48883cc4e4074c60a0b80c03df63c7e1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:07.472942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8144ae-6b79-4944-bed9-779bb708ddfe admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:07.477792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:07.485349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d0882-ff83-47a8-b9bc-e190f7def038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:07.486471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d0882-ff83-47a8-b9bc-e190f7def038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.491692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d0882-ff83-47a8-b9bc-e190f7def038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.491692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d0882-ff83-47a8-b9bc-e190f7def038 admin admin] PATH_INFO: `/v3/projects/a58f3e88d2ea44519d5b97c7beb44422/users/125ed4868fbd481588c085fa65bf14bd/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.524635 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d0882-ff83-47a8-b9bc-e190f7def038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58f3e88d2ea44519d5b97c7beb44422, user_id=125ed4868fbd481588c085fa65bf14bd, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:07.532862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d0882-ff83-47a8-b9bc-e190f7def038 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:07.611009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 850/1694] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:07 2022] PUT /identity/v3/projects/a58f3e88d2ea44519d5b97c7beb44422/users/125ed4868fbd481588c085fa65bf14bd/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:07.611009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e63e0-90d4-41f7-af8a-29a64b109ca6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.611009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e63e0-90d4-41f7-af8a-29a64b109ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.611009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e63e0-90d4-41f7-af8a-29a64b109ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.643479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7c4e63e0-90d4-41f7-af8a-29a64b109ca6 None None] MFA Rules not processed for user `0f2e39e6571b414084ecb3ed71d8e682`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:07.644959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7c4e63e0-90d4-41f7-af8a-29a64b109ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:07.697406 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48883cc4e4074c60a0b80c03df63c7e1', 'request_id': 'req-11706189-f7a8-482a-b56a-92b5090cc423'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:07.709630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48883cc4e4074c60a0b80c03df63c7e1', 'request_id': 'req-11706189-f7a8-482a-b56a-92b5090cc423'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:07.768576 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 851/1695] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:07.769913 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181ada0-ee98-4a7e-a0d3-c63f598b91b7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.770257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181ada0-ee98-4a7e-a0d3-c63f598b91b7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.770556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181ada0-ee98-4a7e-a0d3-c63f598b91b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.791709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1181ada0-ee98-4a7e-a0d3-c63f598b91b7 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:07.793134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1181ada0-ee98-4a7e-a0d3-c63f598b91b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:07.824912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48883cc4e4074c60a0b80c03df63c7e1', 'request_id': 'req-11706189-f7a8-482a-b56a-92b5090cc423'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:07.845266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] The token cache is being invalidate because project 48883cc4e4074c60a0b80c03df63c7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:07.845613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:07.846535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:07.851798 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 845/1696] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:07 2022] DELETE /identity/v3/projects/48883cc4e4074c60a0b80c03df63c7e1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:07.856061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:07.860885 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:07.906989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 852/1697] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:07.906989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd6917-9adc-413b-9ce3-c5c296baff96 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.906989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd6917-9adc-413b-9ce3-c5c296baff96 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.906989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd6917-9adc-413b-9ce3-c5c296baff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.932487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-10bd6917-9adc-413b-9ce3-c5c296baff96 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:07.933959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-10bd6917-9adc-413b-9ce3-c5c296baff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:07.945144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 853/1698] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:07.946059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd6917-9adc-413b-9ce3-c5c296baff96 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:07.975169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-10bd6917-9adc-413b-9ce3-c5c296baff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:08.015976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11706189-f7a8-482a-b56a-92b5090cc423 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:08.027431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cabe1-1f8c-4309-aeed-72ac412ab4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:08.028639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cabe1-1f8c-4309-aeed-72ac412ab4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.028842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cabe1-1f8c-4309-aeed-72ac412ab4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.029127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cabe1-1f8c-4309-aeed-72ac412ab4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.030842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cabe1-1f8c-4309-aeed-72ac412ab4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:08.035353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cabe1-1f8c-4309-aeed-72ac412ab4e8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:08.093616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd6917-9adc-413b-9ce3-c5c296baff96 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:08.099511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2cdff-cfd3-4492-add5-02860aa403bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:08.100603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2cdff-cfd3-4492-add5-02860aa403bd service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.101108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2cdff-cfd3-4492-add5-02860aa403bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.101863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2cdff-cfd3-4492-add5-02860aa403bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.114639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2cdff-cfd3-4492-add5-02860aa403bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:08.116857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2cdff-cfd3-4492-add5-02860aa403bd service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:08.136464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 854/1699] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:08.138437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a627dc7-7ec2-4351-bd22-5f51e56694e8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.139328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a627dc7-7ec2-4351-bd22-5f51e56694e8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.142814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a627dc7-7ec2-4351-bd22-5f51e56694e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.156572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 846/1700] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:07 2022] POST /identity/v3/projects => generated 369 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:08.160906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cabe1-1f8c-4309-aeed-72ac412ab4e8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:08.174412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3a627dc7-7ec2-4351-bd22-5f51e56694e8 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:08.176181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3a627dc7-7ec2-4351-bd22-5f51e56694e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:08.317857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cabe1-1f8c-4309-aeed-72ac412ab4e8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:08.331325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebd922-dac4-4292-92ab-eba7f83e3277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:08.332238 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebd922-dac4-4292-92ab-eba7f83e3277 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.332871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebd922-dac4-4292-92ab-eba7f83e3277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.333402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebd922-dac4-4292-92ab-eba7f83e3277 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.336257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebd922-dac4-4292-92ab-eba7f83e3277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:08.340732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebd922-dac4-4292-92ab-eba7f83e3277 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:08.358178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 855/1701] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:08.375766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732214cd-cc31-4541-8b4a-fc003a3edcc1 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.376067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732214cd-cc31-4541-8b4a-fc003a3edcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.376347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732214cd-cc31-4541-8b4a-fc003a3edcc1 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.377776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 856/1702] 10.222.0.13 () {54 vars in 912 bytes} [Thu Jun 2 10:13:08 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:08.379793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732214cd-cc31-4541-8b4a-fc003a3edcc1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:08.413740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732214cd-cc31-4541-8b4a-fc003a3edcc1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:08.422062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6047d-8899-46c1-b707-66adf45102ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:08.423230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6047d-8899-46c1-b707-66adf45102ea admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.423864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6047d-8899-46c1-b707-66adf45102ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.424451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6047d-8899-46c1-b707-66adf45102ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.425605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6047d-8899-46c1-b707-66adf45102ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:08.426108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6047d-8899-46c1-b707-66adf45102ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:08.428596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6047d-8899-46c1-b707-66adf45102ea admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:08.446352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 857/1703] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:08.449362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b7ec-4d20-46ec-85f7-b92063956bd8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.449948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b7ec-4d20-46ec-85f7-b92063956bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.450435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b7ec-4d20-46ec-85f7-b92063956bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.494135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7866b7ec-4d20-46ec-85f7-b92063956bd8 None None] MFA Rules not processed for user `4bc0ef455caa4ee5b6b86dc1904d4e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:08.495642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7866b7ec-4d20-46ec-85f7-b92063956bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:08.501517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 847/1704] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:08 2022] POST /identity/v3/users => generated 291 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:08.502294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebd922-dac4-4292-92ab-eba7f83e3277 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:08.524180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebd922-dac4-4292-92ab-eba7f83e3277 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:08.532740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e090742-f463-4783-a609-a1c06baf8e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:08.533410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e090742-f463-4783-a609-a1c06baf8e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.534230 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e090742-f463-4783-a609-a1c06baf8e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.534230 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e090742-f463-4783-a609-a1c06baf8e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.534879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e090742-f463-4783-a609-a1c06baf8e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:08.537069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e090742-f463-4783-a609-a1c06baf8e0e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:08.576227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 858/1705] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:13:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:08.577664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064d124-f320-4aa7-922d-5265892437c7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.577952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064d124-f320-4aa7-922d-5265892437c7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.578229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064d124-f320-4aa7-922d-5265892437c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.614916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0064d124-f320-4aa7-922d-5265892437c7 None None] MFA Rules not processed for user `0514d3b22d94435196f8bf1eff26699e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:08.616220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0064d124-f320-4aa7-922d-5265892437c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:08.676233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 848/1706] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:08 2022] POST /identity/v3/projects => generated 363 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:08.676233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e090742-f463-4783-a609-a1c06baf8e0e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:08.764917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:08.792390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 859/1707] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:08.793304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064d124-f320-4aa7-922d-5265892437c7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:08.802048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0064d124-f320-4aa7-922d-5265892437c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:08.828636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064d124-f320-4aa7-922d-5265892437c7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:08.831630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:08.836140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e090742-f463-4783-a609-a1c06baf8e0e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:08.847710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21064ce2-0846-4fc5-9e6e-d8d604a32cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:08.848588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21064ce2-0846-4fc5-9e6e-d8d604a32cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.848874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21064ce2-0846-4fc5-9e6e-d8d604a32cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.849154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21064ce2-0846-4fc5-9e6e-d8d604a32cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.850490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21064ce2-0846-4fc5-9e6e-d8d604a32cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:08.853088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21064ce2-0846-4fc5-9e6e-d8d604a32cf1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:08.867067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 849/1708] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:08.868253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21064ce2-0846-4fc5-9e6e-d8d604a32cf1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:08.881202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21064ce2-0846-4fc5-9e6e-d8d604a32cf1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:08.889295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846a8a-98f2-4a5d-ac22-63009c845f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:08.889994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846a8a-98f2-4a5d-ac22-63009c845f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.891365 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846a8a-98f2-4a5d-ac22-63009c845f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.891365 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846a8a-98f2-4a5d-ac22-63009c845f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.891365 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02846a8a-98f2-4a5d-ac22-63009c845f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:08.894422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02846a8a-98f2-4a5d-ac22-63009c845f8d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:08.910397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889227a-0ba6-4269-9571-e3ccbe99df3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:08.911187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889227a-0ba6-4269-9571-e3ccbe99df3e service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:08.911532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889227a-0ba6-4269-9571-e3ccbe99df3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:08.912030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889227a-0ba6-4269-9571-e3ccbe99df3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:08.928380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889227a-0ba6-4269-9571-e3ccbe99df3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:08.930954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889227a-0ba6-4269-9571-e3ccbe99df3e service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:08.941974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 860/1709] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:08.942890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889227a-0ba6-4269-9571-e3ccbe99df3e service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:08.947993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8889227a-0ba6-4269-9571-e3ccbe99df3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:09.023025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 850/1710] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:08 2022] POST /identity/v3/users => generated 282 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:09.023540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846a8a-98f2-4a5d-ac22-63009c845f8d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:09.037540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846a8a-98f2-4a5d-ac22-63009c845f8d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:09.045031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a8b2d-361d-4a50-adb2-d8d181d3e168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:09.046889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a8b2d-361d-4a50-adb2-d8d181d3e168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.047286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a8b2d-361d-4a50-adb2-d8d181d3e168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.047613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a8b2d-361d-4a50-adb2-d8d181d3e168 admin admin] PATH_INFO: `/v3/projects/fe02e3f5ed574a89994730105532f4a0/users/c68b9924838544e9b33a197352c5273a/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.058834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889227a-0ba6-4269-9571-e3ccbe99df3e service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:09.066577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9290d-6cf8-4ec6-881b-b6c0dd9c2b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:09.067702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9290d-6cf8-4ec6-881b-b6c0dd9c2b5b service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.068127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9290d-6cf8-4ec6-881b-b6c0dd9c2b5b service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.068501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9290d-6cf8-4ec6-881b-b6c0dd9c2b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.078036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a8b2d-361d-4a50-adb2-d8d181d3e168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe02e3f5ed574a89994730105532f4a0, user_id=c68b9924838544e9b33a197352c5273a, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:09.081876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a8b2d-361d-4a50-adb2-d8d181d3e168 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:09.198251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 851/1711] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:09 2022] PUT /identity/v3/projects/fe02e3f5ed574a89994730105532f4a0/users/c68b9924838544e9b33a197352c5273a/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:09.198251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a8b2d-361d-4a50-adb2-d8d181d3e168 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:09.205309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9290d-6cf8-4ec6-881b-b6c0dd9c2b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:09.206389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9290d-6cf8-4ec6-881b-b6c0dd9c2b5b service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:09.259250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 861/1712] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:09.259250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9290d-6cf8-4ec6-881b-b6c0dd9c2b5b service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:09.296904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9290d-6cf8-4ec6-881b-b6c0dd9c2b5b service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:09.326368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a8b2d-361d-4a50-adb2-d8d181d3e168 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:09.336096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49cac9-fa98-4845-b015-2ebac8ba0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:09.337369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49cac9-fa98-4845-b015-2ebac8ba0500 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.337799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49cac9-fa98-4845-b015-2ebac8ba0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.338273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49cac9-fa98-4845-b015-2ebac8ba0500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.339272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49cac9-fa98-4845-b015-2ebac8ba0500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:09.341301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49cac9-fa98-4845-b015-2ebac8ba0500 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:09.373851 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 852/1713] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:09.376692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49cac9-fa98-4845-b015-2ebac8ba0500 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:09.390046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49cac9-fa98-4845-b015-2ebac8ba0500 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:09.404905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cfe57-7299-4027-89f3-d544f60c6af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:09.405596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cfe57-7299-4027-89f3-d544f60c6af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.405880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cfe57-7299-4027-89f3-d544f60c6af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.410522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cfe57-7299-4027-89f3-d544f60c6af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.410522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cfe57-7299-4027-89f3-d544f60c6af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:09.410522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cfe57-7299-4027-89f3-d544f60c6af0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:09.445304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 853/1714] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:09.449082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cfe57-7299-4027-89f3-d544f60c6af0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:09.470781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cfe57-7299-4027-89f3-d544f60c6af0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:09.486931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574ea72-61d9-48bf-a3ad-a5ea3cbb46ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:09.488141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ea72-61d9-48bf-a3ad-a5ea3cbb46ad admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.488880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ea72-61d9-48bf-a3ad-a5ea3cbb46ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.489366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a29c3-f967-4880-8567-8a72397f79ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:09.489632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ea72-61d9-48bf-a3ad-a5ea3cbb46ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.490426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a29c3-f967-4880-8567-8a72397f79ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.490588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a29c3-f967-4880-8567-8a72397f79ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.490874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a29c3-f967-4880-8567-8a72397f79ba admin admin] PATH_INFO: `/v3/projects/60ee3c495ce54612b586fb3f6f0df53f/users/b8311bb6457e4d40b1b4b8f41b76585b/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.491511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574ea72-61d9-48bf-a3ad-a5ea3cbb46ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:09.494616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574ea72-61d9-48bf-a3ad-a5ea3cbb46ad admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:09.515174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 862/1715] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:09.531537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574ea72-61d9-48bf-a3ad-a5ea3cbb46ad admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:09.540846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a29c3-f967-4880-8567-8a72397f79ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ee3c495ce54612b586fb3f6f0df53f, user_id=b8311bb6457e4d40b1b4b8f41b76585b, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:09.547600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a29c3-f967-4880-8567-8a72397f79ba admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:09.590135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574ea72-61d9-48bf-a3ad-a5ea3cbb46ad admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:09.606007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671241f6-96ad-4b97-a2ad-d905777b019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:09.607600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671241f6-96ad-4b97-a2ad-d905777b019f admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.608661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671241f6-96ad-4b97-a2ad-d905777b019f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.613185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671241f6-96ad-4b97-a2ad-d905777b019f admin admin] PATH_INFO: `/v3/projects/fe02e3f5ed574a89994730105532f4a0/users/c68b9924838544e9b33a197352c5273a/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.613185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671241f6-96ad-4b97-a2ad-d905777b019f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe02e3f5ed574a89994730105532f4a0, user_id=c68b9924838544e9b33a197352c5273a, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:09.614769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671241f6-96ad-4b97-a2ad-d905777b019f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:09.630742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 863/1716] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:09 2022] PUT /identity/v3/projects/fe02e3f5ed574a89994730105532f4a0/users/c68b9924838544e9b33a197352c5273a/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:09.644512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80412919-cc28-4fb4-90bd-4b9a7f1dacee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.644836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80412919-cc28-4fb4-90bd-4b9a7f1dacee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.645080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80412919-cc28-4fb4-90bd-4b9a7f1dacee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.692014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 854/1717] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:09 2022] PUT /identity/v3/projects/60ee3c495ce54612b586fb3f6f0df53f/users/b8311bb6457e4d40b1b4b8f41b76585b/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:09.703476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b44741-b0db-4153-bab9-c6adfbc84749 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.703753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b44741-b0db-4153-bab9-c6adfbc84749 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.704943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b44741-b0db-4153-bab9-c6adfbc84749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.709638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-80412919-cc28-4fb4-90bd-4b9a7f1dacee None None] MFA Rules not processed for user `c68b9924838544e9b33a197352c5273a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:09.710954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-80412919-cc28-4fb4-90bd-4b9a7f1dacee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:09.806814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-68b44741-b0db-4153-bab9-c6adfbc84749 None None] MFA Rules not processed for user `b8311bb6457e4d40b1b4b8f41b76585b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:09.809612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68b44741-b0db-4153-bab9-c6adfbc84749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:09.909060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 864/1718] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:09.922880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80412919-cc28-4fb4-90bd-4b9a7f1dacee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:09.925021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-80412919-cc28-4fb4-90bd-4b9a7f1dacee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:09.999883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 855/1719] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:10.008698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b44741-b0db-4153-bab9-c6adfbc84749 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:10.094622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80412919-cc28-4fb4-90bd-4b9a7f1dacee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:10.103014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966e77b-d2d0-4fd4-a154-814484cf0642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:10.104030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966e77b-d2d0-4fd4-a154-814484cf0642 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.104311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966e77b-d2d0-4fd4-a154-814484cf0642 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.109030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966e77b-d2d0-4fd4-a154-814484cf0642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.135532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966e77b-d2d0-4fd4-a154-814484cf0642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:10.137574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966e77b-d2d0-4fd4-a154-814484cf0642 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:10.152990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 865/1720] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:10.165651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b44741-b0db-4153-bab9-c6adfbc84749 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:10.183938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b57ae-f611-4e14-aa9a-4bca2cbd4303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:10.195475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b57ae-f611-4e14-aa9a-4bca2cbd4303 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.195475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b57ae-f611-4e14-aa9a-4bca2cbd4303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.195475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b57ae-f611-4e14-aa9a-4bca2cbd4303 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.195475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b57ae-f611-4e14-aa9a-4bca2cbd4303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:10.195475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b57ae-f611-4e14-aa9a-4bca2cbd4303 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:10.373293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 856/1721] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:10 2022] POST /identity/v3/projects => generated 363 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:10.379284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966e77b-d2d0-4fd4-a154-814484cf0642 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:10.391262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966e77b-d2d0-4fd4-a154-814484cf0642 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:10.442111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01cc02-344a-43e4-9e45-4813ee058625 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.447265 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01cc02-344a-43e4-9e45-4813ee058625 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.447265 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01cc02-344a-43e4-9e45-4813ee058625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.470305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:10.489251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3b01cc02-344a-43e4-9e45-4813ee058625 None None] MFA Rules not processed for user `a696d00855ef439c9d80b6bec5312f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:10.502546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3b01cc02-344a-43e4-9e45-4813ee058625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:10.513165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b41546-6551-437f-8a69-ba64f42d6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:10.513936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b41546-6551-437f-8a69-ba64f42d6aff admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.514130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b41546-6551-437f-8a69-ba64f42d6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.514406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b41546-6551-437f-8a69-ba64f42d6aff admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.515201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b41546-6551-437f-8a69-ba64f42d6aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:10.517316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b41546-6551-437f-8a69-ba64f42d6aff admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:10.658079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 857/1722] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:10.679115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 866/1723] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:10 2022] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:10.683569 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01cc02-344a-43e4-9e45-4813ee058625 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:10.699938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4445eb2-1b77-46f1-b4de-3861bcf9208d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.700469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4445eb2-1b77-46f1-b4de-3861bcf9208d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.700888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4445eb2-1b77-46f1-b4de-3861bcf9208d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.702036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01cc02-344a-43e4-9e45-4813ee058625 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:10.714692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784a051-ee1e-44dc-bdca-83bfcdd92b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:10.721614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a051-ee1e-44dc-bdca-83bfcdd92b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.724156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a051-ee1e-44dc-bdca-83bfcdd92b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.725043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a051-ee1e-44dc-bdca-83bfcdd92b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.726063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784a051-ee1e-44dc-bdca-83bfcdd92b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:10.728444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d4445eb2-1b77-46f1-b4de-3861bcf9208d None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:10.729308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784a051-ee1e-44dc-bdca-83bfcdd92b19 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:10.733561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d4445eb2-1b77-46f1-b4de-3861bcf9208d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:10.811846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 858/1724] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:10.817389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7aebb-d2ad-4455-8012-b0fc7fae45a8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.818679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7aebb-d2ad-4455-8012-b0fc7fae45a8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.819361 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7aebb-d2ad-4455-8012-b0fc7fae45a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.879779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 867/1725] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:13:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:10.885590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4445eb2-1b77-46f1-b4de-3861bcf9208d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:10.894495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-04b7aebb-d2ad-4455-8012-b0fc7fae45a8 None None] MFA Rules not processed for user `125ed4868fbd481588c085fa65bf14bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:10.897777 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-04b7aebb-d2ad-4455-8012-b0fc7fae45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:10.899223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4445eb2-1b77-46f1-b4de-3861bcf9208d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:10.904171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3339006-7f42-4b82-a97c-168699d37c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:10.905417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3339006-7f42-4b82-a97c-168699d37c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.905836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3339006-7f42-4b82-a97c-168699d37c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.906411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3339006-7f42-4b82-a97c-168699d37c4d admin admin] PATH_INFO: `/v3/projects/01b59d8de2294a28b6968d7799332bf3/users/9cb1a2303ce743b6853cea75758d5fd9/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.982896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3339006-7f42-4b82-a97c-168699d37c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b59d8de2294a28b6968d7799332bf3, user_id=9cb1a2303ce743b6853cea75758d5fd9, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:11.005677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3339006-7f42-4b82-a97c-168699d37c4d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:11.112929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 868/1726] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:10 2022] PUT /identity/v3/projects/01b59d8de2294a28b6968d7799332bf3/users/9cb1a2303ce743b6853cea75758d5fd9/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:11.117709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3339006-7f42-4b82-a97c-168699d37c4d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:11.165332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 859/1727] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:11.171962 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7aebb-d2ad-4455-8012-b0fc7fae45a8 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:11.174820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-04b7aebb-d2ad-4455-8012-b0fc7fae45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:11.200676 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7aebb-d2ad-4455-8012-b0fc7fae45a8 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.312278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3339006-7f42-4b82-a97c-168699d37c4d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.315670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55f8cb-b702-4486-8ea6-59f841382535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.316523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55f8cb-b702-4486-8ea6-59f841382535 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.317209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55f8cb-b702-4486-8ea6-59f841382535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.317579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55f8cb-b702-4486-8ea6-59f841382535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.318927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55f8cb-b702-4486-8ea6-59f841382535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:11.325426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55f8cb-b702-4486-8ea6-59f841382535 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:11.329291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083774f3-6d7d-4f5a-b78c-5572a4a972bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.332071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083774f3-6d7d-4f5a-b78c-5572a4a972bc admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.332520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083774f3-6d7d-4f5a-b78c-5572a4a972bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.333900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083774f3-6d7d-4f5a-b78c-5572a4a972bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.334766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083774f3-6d7d-4f5a-b78c-5572a4a972bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:11.338806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083774f3-6d7d-4f5a-b78c-5572a4a972bc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:11.374856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 869/1728] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:11.379146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083774f3-6d7d-4f5a-b78c-5572a4a972bc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:11.393162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083774f3-6d7d-4f5a-b78c-5572a4a972bc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.400757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d48be8-52cd-4469-8f4e-e5a2608dea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.402695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d48be8-52cd-4469-8f4e-e5a2608dea64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.403381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d48be8-52cd-4469-8f4e-e5a2608dea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.405735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d48be8-52cd-4469-8f4e-e5a2608dea64 admin admin] PATH_INFO: `/v3/projects/01b59d8de2294a28b6968d7799332bf3/users/9cb1a2303ce743b6853cea75758d5fd9/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.406465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d48be8-52cd-4469-8f4e-e5a2608dea64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b59d8de2294a28b6968d7799332bf3, user_id=9cb1a2303ce743b6853cea75758d5fd9, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:11.409489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d48be8-52cd-4469-8f4e-e5a2608dea64 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:11.440553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 870/1729] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:11 2022] PUT /identity/v3/projects/01b59d8de2294a28b6968d7799332bf3/users/9cb1a2303ce743b6853cea75758d5fd9/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:11.453187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac3310-33e0-4215-bf29-f9eeb37b3de8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.453187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac3310-33e0-4215-bf29-f9eeb37b3de8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.453187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac3310-33e0-4215-bf29-f9eeb37b3de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.485174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d2ac3310-33e0-4215-bf29-f9eeb37b3de8 None None] MFA Rules not processed for user `9cb1a2303ce743b6853cea75758d5fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:11.486498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d2ac3310-33e0-4215-bf29-f9eeb37b3de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:11.559196 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 860/1730] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:11 2022] POST /identity/v3/projects => generated 401 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:11.560010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55f8cb-b702-4486-8ea6-59f841382535 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:11.566416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a55f8cb-b702-4486-8ea6-59f841382535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:11.650457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 871/1731] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:11 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:11.652533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac3310-33e0-4215-bf29-f9eeb37b3de8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:11.667849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:11.787144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac3310-33e0-4215-bf29-f9eeb37b3de8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.840929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55f8cb-b702-4486-8ea6-59f841382535 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.875882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81edba0-5897-4754-8f02-cd6e701a24a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.876565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81edba0-5897-4754-8f02-cd6e701a24a0 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.876935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81edba0-5897-4754-8f02-cd6e701a24a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.877725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81edba0-5897-4754-8f02-cd6e701a24a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.949684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b4e94-a00b-4db4-a25b-c08344088ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.950570 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b4e94-a00b-4db4-a25b-c08344088ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.950914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b4e94-a00b-4db4-a25b-c08344088ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.951213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b4e94-a00b-4db4-a25b-c08344088ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.951919 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b4e94-a00b-4db4-a25b-c08344088ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:11.956266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b4e94-a00b-4db4-a25b-c08344088ce3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.010360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81edba0-5897-4754-8f02-cd6e701a24a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.012786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81edba0-5897-4754-8f02-cd6e701a24a0 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.025715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 861/1732] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:13:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:13:12.041577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81edba0-5897-4754-8f02-cd6e701a24a0 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:12.041577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e81edba0-5897-4754-8f02-cd6e701a24a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:12.067361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 872/1733] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:11 2022] POST /identity/v3/users => generated 307 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:12.072069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b4e94-a00b-4db4-a25b-c08344088ce3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:12.102374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b4e94-a00b-4db4-a25b-c08344088ce3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:12.124160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6f0e-956b-44a2-94cc-a1679d8470fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:12.124875 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6f0e-956b-44a2-94cc-a1679d8470fe admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:12.129036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6f0e-956b-44a2-94cc-a1679d8470fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:12.129574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6f0e-956b-44a2-94cc-a1679d8470fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:12.130370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e6f0e-956b-44a2-94cc-a1679d8470fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.132025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e6f0e-956b-44a2-94cc-a1679d8470fe admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.160720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 873/1734] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:12.166768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6f0e-956b-44a2-94cc-a1679d8470fe admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:12.209341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6f0e-956b-44a2-94cc-a1679d8470fe admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:12.215150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81edba0-5897-4754-8f02-cd6e701a24a0 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:12.228577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da632fc-11cc-4a82-910c-6b80da1dd301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:12.231846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23219f04-ac48-4251-b8be-3856f37a2f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:12.233048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da632fc-11cc-4a82-910c-6b80da1dd301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:12.233464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219f04-ac48-4251-b8be-3856f37a2f3c service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:12.233721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da632fc-11cc-4a82-910c-6b80da1dd301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:12.233818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219f04-ac48-4251-b8be-3856f37a2f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:12.234025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219f04-ac48-4251-b8be-3856f37a2f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:12.234130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da632fc-11cc-4a82-910c-6b80da1dd301 admin admin] PATH_INFO: `/v3/projects/12d5772fa5964552be409123291b6372/users/08e5adf87c8c4b10a9cc2b9f9df425c8/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:12.294949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da632fc-11cc-4a82-910c-6b80da1dd301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d5772fa5964552be409123291b6372, user_id=08e5adf87c8c4b10a9cc2b9f9df425c8, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.299053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da632fc-11cc-4a82-910c-6b80da1dd301 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.382567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23219f04-ac48-4251-b8be-3856f37a2f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.387181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23219f04-ac48-4251-b8be-3856f37a2f3c service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.405765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 862/1735] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:12.411917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 874/1736] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:12 2022] PUT /identity/v3/projects/12d5772fa5964552be409123291b6372/users/08e5adf87c8c4b10a9cc2b9f9df425c8/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:12.415807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23219f04-ac48-4251-b8be-3856f37a2f3c service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:12.455575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23219f04-ac48-4251-b8be-3856f37a2f3c service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:12.707818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f66b-d9cb-4327-8d82-0bb585ccecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:12.712930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f66b-d9cb-4327-8d82-0bb585ccecac admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:12.712930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f66b-d9cb-4327-8d82-0bb585ccecac admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:12.712930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f66b-d9cb-4327-8d82-0bb585ccecac admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:12.712930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9f66b-d9cb-4327-8d82-0bb585ccecac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.724710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9f66b-d9cb-4327-8d82-0bb585ccecac admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.782944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 863/1737] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:12.792090 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da632fc-11cc-4a82-910c-6b80da1dd301 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:12.821195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da632fc-11cc-4a82-910c-6b80da1dd301 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:12.856025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e1964-6740-403b-9ba3-439893b60c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:12.857168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1964-6740-403b-9ba3-439893b60c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:12.857449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1964-6740-403b-9ba3-439893b60c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:12.857905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1964-6740-403b-9ba3-439893b60c40 admin admin] PATH_INFO: `/v3/projects/12d5772fa5964552be409123291b6372/users/08e5adf87c8c4b10a9cc2b9f9df425c8/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:12.883450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e1964-6740-403b-9ba3-439893b60c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d5772fa5964552be409123291b6372, user_id=08e5adf87c8c4b10a9cc2b9f9df425c8, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.899509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e1964-6740-403b-9ba3-439893b60c40 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.939645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 875/1738] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:12 2022] PUT /identity/v3/projects/12d5772fa5964552be409123291b6372/users/08e5adf87c8c4b10a9cc2b9f9df425c8/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:13.178932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d829a-3bb7-4981-a153-bbe1056c0a83 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:13.179086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d829a-3bb7-4981-a153-bbe1056c0a83 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:13.180747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d829a-3bb7-4981-a153-bbe1056c0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:13.228895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-812d829a-3bb7-4981-a153-bbe1056c0a83 None None] MFA Rules not processed for user `4bc0ef455caa4ee5b6b86dc1904d4e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:13.230174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-812d829a-3bb7-4981-a153-bbe1056c0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:13.335268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e1964-6740-403b-9ba3-439893b60c40 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:13.438431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 864/1739] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Jun 2 10:13:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:13.438431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d829a-3bb7-4981-a153-bbe1056c0a83 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:13.438431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d829a-3bb7-4981-a153-bbe1056c0a83 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:13.440582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e1964-6740-403b-9ba3-439893b60c40 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:13.440582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e465e0-bf6f-4599-8570-073881bcaa56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:13.440765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1896edd-2de9-4ff0-82c9-242d645af366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:13.440857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e465e0-bf6f-4599-8570-073881bcaa56 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:13.440857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e465e0-bf6f-4599-8570-073881bcaa56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:13.441008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1896edd-2de9-4ff0-82c9-242d645af366 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:13.441095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e465e0-bf6f-4599-8570-073881bcaa56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:13.441178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1896edd-2de9-4ff0-82c9-242d645af366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:13.441178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1896edd-2de9-4ff0-82c9-242d645af366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:13.446031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1896edd-2de9-4ff0-82c9-242d645af366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:13.448413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1896edd-2de9-4ff0-82c9-242d645af366 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:13.465820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 865/1740] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:13.493797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:13.638641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e465e0-bf6f-4599-8570-073881bcaa56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:13.638641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e465e0-bf6f-4599-8570-073881bcaa56 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:13.638641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 876/1741] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:13.776145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:15.675405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:16.234014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1d25b-b4d1-416c-8df5-594b5459b8fe None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:16.234734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1d25b-b4d1-416c-8df5-594b5459b8fe None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:16.234734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1d25b-b4d1-416c-8df5-594b5459b8fe None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:16.236194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 866/1742] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:16.238719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:16.272023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b762-7b1e-4f6e-92af-27b5300e572f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:16.272520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b762-7b1e-4f6e-92af-27b5300e572f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:16.272868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b762-7b1e-4f6e-92af-27b5300e572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:16.293776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8a60b762-7b1e-4f6e-92af-27b5300e572f None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:16.295790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8a60b762-7b1e-4f6e-92af-27b5300e572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:16.318045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90977-0bdc-47ea-978a-d8315d65e780 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:16.318326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90977-0bdc-47ea-978a-d8315d65e780 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:16.318602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90977-0bdc-47ea-978a-d8315d65e780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:16.373042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-edd90977-0bdc-47ea-978a-d8315d65e780 None None] MFA Rules not processed for user `0514d3b22d94435196f8bf1eff26699e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:16.374677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-edd90977-0bdc-47ea-978a-d8315d65e780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:16.401925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 877/1743] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:16.422094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b762-7b1e-4f6e-92af-27b5300e572f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:16.434668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b762-7b1e-4f6e-92af-27b5300e572f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:16.442132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527ba7-00b5-493c-bc04-b8babd562496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:16.443144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527ba7-00b5-493c-bc04-b8babd562496 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:16.443649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527ba7-00b5-493c-bc04-b8babd562496 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:16.444201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527ba7-00b5-493c-bc04-b8babd562496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:16.457529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527ba7-00b5-493c-bc04-b8babd562496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:16.459398 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527ba7-00b5-493c-bc04-b8babd562496 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:16.468825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 867/1744] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:16.482151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 878/1745] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:16.567205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:16.802666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3159754-8abc-4025-8c0b-83d9c749f810 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:16.802964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3159754-8abc-4025-8c0b-83d9c749f810 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:16.803289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3159754-8abc-4025-8c0b-83d9c749f810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:16.902603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b3159754-8abc-4025-8c0b-83d9c749f810 None None] MFA Rules not processed for user `08e5adf87c8c4b10a9cc2b9f9df425c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:16.906088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b3159754-8abc-4025-8c0b-83d9c749f810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:17.138673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 868/1746] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:17.261936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:17.744341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:18.361402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:18.936886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:19.694044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527ba7-00b5-493c-bc04-b8babd562496 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:19.775511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:19.821209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527ba7-00b5-493c-bc04-b8babd562496 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:19.849041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:19.850322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:19.853283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:19.853982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] PATH_INFO: `/v3/users/0f2e39e6571b414084ecb3ed71d8e682` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:19.858518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2e39e6571b414084ecb3ed71d8e682)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:19.865676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:19.896321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68f03c-cdb6-41c8-9bb2-4031b7a981ed None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:19.896321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68f03c-cdb6-41c8-9bb2-4031b7a981ed None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:19.896321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68f03c-cdb6-41c8-9bb2-4031b7a981ed None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:19.897278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 869/1747] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:13:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:20.003713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922222-5049-4148-a48b-f165a7b44b7b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.004788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922222-5049-4148-a48b-f165a7b44b7b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.005714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922222-5049-4148-a48b-f165a7b44b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.037494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e4922222-5049-4148-a48b-f165a7b44b7b None None] MFA Rules not processed for user `bef7eacc5dc0445fa3297db10c8b4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:20.038949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e4922222-5049-4148-a48b-f165a7b44b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:20.115309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2e39e6571b414084ecb3ed71d8e682'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:20.117754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2e39e6571b414084ecb3ed71d8e682'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:20.118680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2e39e6571b414084ecb3ed71d8e682'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:20.163320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2e39e6571b414084ecb3ed71d8e682'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:20.180288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-01af8bbe-7ddf-40fd-b9be-e05c5db665cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2e39e6571b414084ecb3ed71d8e682'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:20.195031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 870/1748] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:13:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:20.251375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4922222-5049-4148-a48b-f165a7b44b7b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:20.251375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e4922222-5049-4148-a48b-f165a7b44b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:20.283503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 879/1749] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:19 2022] DELETE /identity/v3/users/0f2e39e6571b414084ecb3ed71d8e682 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:20.285066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2e382-b895-4423-9fd7-477eab79b97f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.285366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2e382-b895-4423-9fd7-477eab79b97f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.285651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2e382-b895-4423-9fd7-477eab79b97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.296070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:20.314687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4922222-5049-4148-a48b-f165a7b44b7b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:20.363566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-91a2e382-b895-4423-9fd7-477eab79b97f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:20.367461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-91a2e382-b895-4423-9fd7-477eab79b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:20.438950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79b2cf-da2b-4d88-ac98-d292b133261e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:20.440223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b2cf-da2b-4d88-ac98-d292b133261e service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.440725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b2cf-da2b-4d88-ac98-d292b133261e service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.441203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b2cf-da2b-4d88-ac98-d292b133261e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.453458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79b2cf-da2b-4d88-ac98-d292b133261e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:20.455540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79b2cf-da2b-4d88-ac98-d292b133261e service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:20.475430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 871/1750] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:20.479235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79b2cf-da2b-4d88-ac98-d292b133261e service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:20.487870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2f79b2cf-da2b-4d88-ac98-d292b133261e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:20.563596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 880/1751] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:20.618195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2e382-b895-4423-9fd7-477eab79b97f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:20.621303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-91a2e382-b895-4423-9fd7-477eab79b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:20.691246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79b2cf-da2b-4d88-ac98-d292b133261e service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:20.702569 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:20.704975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.706117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.707305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] PATH_INFO: `/v3/users/a6d26b1c907f432a9666744901f2d315` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.710444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d26b1c907f432a9666744901f2d315)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:20.714589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:20.739275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2e382-b895-4423-9fd7-477eab79b97f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:20.744636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdab552-2b7a-4052-9bff-2364be85d9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:20.746507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdab552-2b7a-4052-9bff-2364be85d9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.746962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdab552-2b7a-4052-9bff-2364be85d9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.747423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdab552-2b7a-4052-9bff-2364be85d9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.762483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdab552-2b7a-4052-9bff-2364be85d9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:20.764516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdab552-2b7a-4052-9bff-2364be85d9d2 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:20.778912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 881/1752] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:20.975797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d26b1c907f432a9666744901f2d315'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:20.976958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d26b1c907f432a9666744901f2d315'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:20.990575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d26b1c907f432a9666744901f2d315'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:20.998577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d26b1c907f432a9666744901f2d315'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:20.999357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d26b1c907f432a9666744901f2d315'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:21.004650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:21.130604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 872/1753] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:20 2022] DELETE /identity/v3/users/a6d26b1c907f432a9666744901f2d315 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:21.139054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f897d76-7916-44ed-9560-3f3e437602bb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.139752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f897d76-7916-44ed-9560-3f3e437602bb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.140129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f897d76-7916-44ed-9560-3f3e437602bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.161706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4f897d76-7916-44ed-9560-3f3e437602bb None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:21.163363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4f897d76-7916-44ed-9560-3f3e437602bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.202918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:21.262025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 882/1754] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:21.283687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:21.286839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.380278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e191f1-7f05-47ef-8965-2cef2673b7ce admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:21.385313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39393a52-c536-44ce-a8d5-c022c0ef86a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:21.386348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39393a52-c536-44ce-a8d5-c022c0ef86a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.387256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39393a52-c536-44ce-a8d5-c022c0ef86a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.387734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39393a52-c536-44ce-a8d5-c022c0ef86a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.400949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39393a52-c536-44ce-a8d5-c022c0ef86a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:21.403786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39393a52-c536-44ce-a8d5-c022c0ef86a4 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:21.422383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 873/1755] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:21.508927 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f897d76-7916-44ed-9560-3f3e437602bb None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:21.510482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4f897d76-7916-44ed-9560-3f3e437602bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.524191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f897d76-7916-44ed-9560-3f3e437602bb None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:21.529525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:21.533872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.533872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.533872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] PATH_INFO: `/v3/projects/96511f46a66d470e84fc69a52b3c8ab7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.533872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96511f46a66d470e84fc69a52b3c8ab7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:21.534385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:21.681736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:21.696115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96511f46a66d470e84fc69a52b3c8ab7', 'request_id': 'req-8c638446-99ae-4228-ac9f-38059a0dd025'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:21.708545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96511f46a66d470e84fc69a52b3c8ab7', 'request_id': 'req-8c638446-99ae-4228-ac9f-38059a0dd025'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:21.732958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec0b2-6f74-4c5c-84a8-7565c656ce93 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.733259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec0b2-6f74-4c5c-84a8-7565c656ce93 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.733595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec0b2-6f74-4c5c-84a8-7565c656ce93 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.735265 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 874/1756] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:21.782186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8fccf-e350-4719-bd97-8ac4f0083ebd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.788144 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8fccf-e350-4719-bd97-8ac4f0083ebd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.788144 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8fccf-e350-4719-bd97-8ac4f0083ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.805154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e4f8fccf-e350-4719-bd97-8ac4f0083ebd None None] MFA Rules not processed for user `bef7eacc5dc0445fa3297db10c8b4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:21.806311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e4f8fccf-e350-4719-bd97-8ac4f0083ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.806595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96511f46a66d470e84fc69a52b3c8ab7', 'request_id': 'req-8c638446-99ae-4228-ac9f-38059a0dd025'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:21.822003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] The token cache is being invalidate because project 96511f46a66d470e84fc69a52b3c8ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:21.822695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:21.823426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:21.825511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 883/1757] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:21 2022] DELETE /identity/v3/projects/96511f46a66d470e84fc69a52b3c8ab7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:21.829354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:21.831194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.891696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 875/1758] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:21.909289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8fccf-e350-4719-bd97-8ac4f0083ebd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:21.911485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e4f8fccf-e350-4719-bd97-8ac4f0083ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.931621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c638446-99ae-4228-ac9f-38059a0dd025 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:21.931788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8fccf-e350-4719-bd97-8ac4f0083ebd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:21.935501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:21.936019 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b445952-dc03-4c55-8c63-a042241237ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:21.936439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.936881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.937086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b445952-dc03-4c55-8c63-a042241237ba service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.937269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] PATH_INFO: `/v3/users/c68b9924838544e9b33a197352c5273a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.937366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b445952-dc03-4c55-8c63-a042241237ba service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.937632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b445952-dc03-4c55-8c63-a042241237ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.938629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68b9924838544e9b33a197352c5273a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:21.941337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:21.948673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b445952-dc03-4c55-8c63-a042241237ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:21.951316 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b445952-dc03-4c55-8c63-a042241237ba service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:21.968001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 876/1759] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:21.977126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b445952-dc03-4c55-8c63-a042241237ba service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:21.978799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7b445952-dc03-4c55-8c63-a042241237ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.996736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b445952-dc03-4c55-8c63-a042241237ba service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:22.000343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:22.001220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:22.001501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:22.001788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] PATH_INFO: `/v3/users/125ed4868fbd481588c085fa65bf14bd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:22.003104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125ed4868fbd481588c085fa65bf14bd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:22.005035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:22.158508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68b9924838544e9b33a197352c5273a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.159240 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68b9924838544e9b33a197352c5273a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.159989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68b9924838544e9b33a197352c5273a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.175775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68b9924838544e9b33a197352c5273a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.198256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68b9924838544e9b33a197352c5273a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.228761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125ed4868fbd481588c085fa65bf14bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.230037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125ed4868fbd481588c085fa65bf14bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.242249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125ed4868fbd481588c085fa65bf14bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.255737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125ed4868fbd481588c085fa65bf14bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.256516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125ed4868fbd481588c085fa65bf14bd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.287369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 884/1760] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:21 2022] DELETE /identity/v3/users/c68b9924838544e9b33a197352c5273a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:22.307301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:22.371429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 877/1761] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:21 2022] DELETE /identity/v3/users/125ed4868fbd481588c085fa65bf14bd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:22.484591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:22.484591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:22.569568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac25b5-4aab-4149-b5a5-770c120905cb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:22.638879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:22.639840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:22.640114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:22.640381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] PATH_INFO: `/v3/projects/bec195176b7f48239fba6463a4828a18` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:22.641539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec195176b7f48239fba6463a4828a18)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:22.643459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:22.693357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:22.694970 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:22.707968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed52569-64e1-4f2f-a75e-c633641c5715 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:22.712753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:22.714309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:22.714643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:22.714921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] PATH_INFO: `/v3/projects/a58f3e88d2ea44519d5b97c7beb44422` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:22.716177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58f3e88d2ea44519d5b97c7beb44422)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:22.718124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:22.783347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec195176b7f48239fba6463a4828a18', 'request_id': 'req-b958acac-e402-4558-a1df-51f578527434'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.792002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec195176b7f48239fba6463a4828a18', 'request_id': 'req-b958acac-e402-4558-a1df-51f578527434'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.825607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58f3e88d2ea44519d5b97c7beb44422', 'request_id': 'req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.833506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58f3e88d2ea44519d5b97c7beb44422', 'request_id': 'req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.880577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec195176b7f48239fba6463a4828a18', 'request_id': 'req-b958acac-e402-4558-a1df-51f578527434'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.893003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] The token cache is being invalidate because project bec195176b7f48239fba6463a4828a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:22.893289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.893925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b958acac-e402-4558-a1df-51f578527434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.895631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 885/1762] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:22 2022] DELETE /identity/v3/projects/bec195176b7f48239fba6463a4828a18 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:22.900161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0dea1-e71b-40d6-b192-3d4971a954f1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:22.900446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0dea1-e71b-40d6-b192-3d4971a954f1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:22.900748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0dea1-e71b-40d6-b192-3d4971a954f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:22.919565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-97e0dea1-e71b-40d6-b192-3d4971a954f1 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:22.920765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-97e0dea1-e71b-40d6-b192-3d4971a954f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:22.954619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58f3e88d2ea44519d5b97c7beb44422', 'request_id': 'req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.966350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] The token cache is being invalidate because project a58f3e88d2ea44519d5b97c7beb44422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:22.966775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.967409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:22.969185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 878/1763] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:22 2022] DELETE /identity/v3/projects/a58f3e88d2ea44519d5b97c7beb44422 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:22.972896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:22.974308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:22.983969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 886/1764] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:22.993299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd0dc5-5cdd-42a2-a91d-d297aaab0fdf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:22.993396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790321b-629f-43c7-ba08-ceac2e968427 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:22.993396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790321b-629f-43c7-ba08-ceac2e968427 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:22.993396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790321b-629f-43c7-ba08-ceac2e968427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:22.997156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:22.998036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:22.998313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:22.999527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] PATH_INFO: `/v3/users/08e5adf87c8c4b10a9cc2b9f9df425c8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.000984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e5adf87c8c4b10a9cc2b9f9df425c8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.003015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:23.012664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4790321b-629f-43c7-ba08-ceac2e968427 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:23.013916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4790321b-629f-43c7-ba08-ceac2e968427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:23.023605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 887/1765] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:23.028111 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790321b-629f-43c7-ba08-ceac2e968427 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:23.029948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4790321b-629f-43c7-ba08-ceac2e968427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:23.041512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790321b-629f-43c7-ba08-ceac2e968427 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:23.046210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:23.047044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.047356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.047621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] PATH_INFO: `/v3/projects/fe02e3f5ed574a89994730105532f4a0` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.048869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe02e3f5ed574a89994730105532f4a0)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.050739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:23.225773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e5adf87c8c4b10a9cc2b9f9df425c8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.226422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e5adf87c8c4b10a9cc2b9f9df425c8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.228706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe02e3f5ed574a89994730105532f4a0', 'request_id': 'req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.237648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe02e3f5ed574a89994730105532f4a0', 'request_id': 'req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.240348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e5adf87c8c4b10a9cc2b9f9df425c8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.249770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e5adf87c8c4b10a9cc2b9f9df425c8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.250598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e5adf87c8c4b10a9cc2b9f9df425c8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.318378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe02e3f5ed574a89994730105532f4a0', 'request_id': 'req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.331470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] The token cache is being invalidate because project fe02e3f5ed574a89994730105532f4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:23.331758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.332565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:23.337575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 888/1766] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:23 2022] DELETE /identity/v3/projects/fe02e3f5ed574a89994730105532f4a0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:23.337575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:23.339451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:23.412594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b51c6-e0f6-475d-9eda-f1a837396cf1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:23.417210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e911556-1b51-4793-a3bc-9e504c1957a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:23.417887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911556-1b51-4793-a3bc-9e504c1957a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.418150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911556-1b51-4793-a3bc-9e504c1957a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.418424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911556-1b51-4793-a3bc-9e504c1957a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.419175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e911556-1b51-4793-a3bc-9e504c1957a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:23.419508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e911556-1b51-4793-a3bc-9e504c1957a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.421077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e911556-1b51-4793-a3bc-9e504c1957a1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:23.432089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 879/1767] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:22 2022] DELETE /identity/v3/users/08e5adf87c8c4b10a9cc2b9f9df425c8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:23.432232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 889/1768] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:23.433903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3d21b-54cd-43b5-b7da-8f91147fa7fb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.434188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3d21b-54cd-43b5-b7da-8f91147fa7fb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.434462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3d21b-54cd-43b5-b7da-8f91147fa7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.437588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:23.439440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:23.453912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5eb3d21b-54cd-43b5-b7da-8f91147fa7fb None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:23.455129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5eb3d21b-54cd-43b5-b7da-8f91147fa7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:23.462472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:23.522225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 890/1769] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:23.524010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0a9a0-c195-474d-8656-fa552368404f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:23.530236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b66a6-ebe2-4c36-9a53-5add76e2319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:23.530930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b66a6-ebe2-4c36-9a53-5add76e2319d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.531250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b66a6-ebe2-4c36-9a53-5add76e2319d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.531364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37566755-a030-4109-9325-afe3b83aa843 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.531660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37566755-a030-4109-9325-afe3b83aa843 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.531977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b66a6-ebe2-4c36-9a53-5add76e2319d admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.532080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37566755-a030-4109-9325-afe3b83aa843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.532726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b66a6-ebe2-4c36-9a53-5add76e2319d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.534708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b66a6-ebe2-4c36-9a53-5add76e2319d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:23.551907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-37566755-a030-4109-9325-afe3b83aa843 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:23.553193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-37566755-a030-4109-9325-afe3b83aa843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:23.563925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 891/1770] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:23.566799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37566755-a030-4109-9325-afe3b83aa843 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:23.577594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37566755-a030-4109-9325-afe3b83aa843 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:23.582448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f95e3-eaf2-46d0-a6e6-2f986509a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:23.583185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f95e3-eaf2-46d0-a6e6-2f986509a55a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.583410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f95e3-eaf2-46d0-a6e6-2f986509a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.583692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f95e3-eaf2-46d0-a6e6-2f986509a55a admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.584407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f95e3-eaf2-46d0-a6e6-2f986509a55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:23.584718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f95e3-eaf2-46d0-a6e6-2f986509a55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.586303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f95e3-eaf2-46d0-a6e6-2f986509a55a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:23.598421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 892/1771] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:13:23.602715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f95e3-eaf2-46d0-a6e6-2f986509a55a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:23.624743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f95e3-eaf2-46d0-a6e6-2f986509a55a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:23.624848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 880/1772] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:23 2022] POST /identity/v3/projects => generated 357 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:23.625560 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b66a6-ebe2-4c36-9a53-5add76e2319d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:23.696569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431abd08-f988-4525-bd03-a3f0c111e445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:23.697661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b66a6-ebe2-4c36-9a53-5add76e2319d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:23.697808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431abd08-f988-4525-bd03-a3f0c111e445 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.698122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431abd08-f988-4525-bd03-a3f0c111e445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.698513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431abd08-f988-4525-bd03-a3f0c111e445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.699380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431abd08-f988-4525-bd03-a3f0c111e445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.705129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431abd08-f988-4525-bd03-a3f0c111e445 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:23.705474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71898e-aa4f-42dd-900c-718a9a500019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:23.705474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71898e-aa4f-42dd-900c-718a9a500019 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.705474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71898e-aa4f-42dd-900c-718a9a500019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.707245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71898e-aa4f-42dd-900c-718a9a500019 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.708188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71898e-aa4f-42dd-900c-718a9a500019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.710558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71898e-aa4f-42dd-900c-718a9a500019 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:23.853895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 881/1773] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:23 2022] POST /identity/v3/users => generated 279 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:23.856668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71898e-aa4f-42dd-900c-718a9a500019 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:23.860013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 893/1774] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:23 2022] POST /identity/v3/projects => generated 367 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:23.860158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2d71898e-aa4f-42dd-900c-718a9a500019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:23.860239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431abd08-f988-4525-bd03-a3f0c111e445 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:23.878452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71898e-aa4f-42dd-900c-718a9a500019 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:23.921988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:23.940245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431abd08-f988-4525-bd03-a3f0c111e445 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:23.941219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:23.942087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.942364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.942673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] PATH_INFO: `/v3/projects/12d5772fa5964552be409123291b6372` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.943986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d5772fa5964552be409123291b6372)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.945271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12ab3-19ec-4613-99b4-da9aa75ad5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:23.945904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12ab3-19ec-4613-99b4-da9aa75ad5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.946203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12ab3-19ec-4613-99b4-da9aa75ad5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.946301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:23.946494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12ab3-19ec-4613-99b4-da9aa75ad5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.947280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c12ab3-19ec-4613-99b4-da9aa75ad5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.948916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c12ab3-19ec-4613-99b4-da9aa75ad5b0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:23.959964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 894/1775] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:23.960187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12ab3-19ec-4613-99b4-da9aa75ad5b0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:23.970398 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12ab3-19ec-4613-99b4-da9aa75ad5b0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:23.975069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1039-ec7c-43da-b8c1-c6d529cdd02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:23.975753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1039-ec7c-43da-b8c1-c6d529cdd02e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:23.976035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1039-ec7c-43da-b8c1-c6d529cdd02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:23.976309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1039-ec7c-43da-b8c1-c6d529cdd02e admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:23.976990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef1039-ec7c-43da-b8c1-c6d529cdd02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:23.978858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef1039-ec7c-43da-b8c1-c6d529cdd02e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.095838 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d5772fa5964552be409123291b6372', 'request_id': 'req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:24.104083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 895/1776] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:23 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:24.104083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1039-ec7c-43da-b8c1-c6d529cdd02e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.104860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d5772fa5964552be409123291b6372', 'request_id': 'req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:24.112425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1039-ec7c-43da-b8c1-c6d529cdd02e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.166356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f404e1-13e1-4fb4-a746-9c002d1cd5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.167600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f404e1-13e1-4fb4-a746-9c002d1cd5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.167881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f404e1-13e1-4fb4-a746-9c002d1cd5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.168185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f404e1-13e1-4fb4-a746-9c002d1cd5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.168892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f404e1-13e1-4fb4-a746-9c002d1cd5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.170465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f404e1-13e1-4fb4-a746-9c002d1cd5f5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.179990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 896/1777] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:24.180636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f404e1-13e1-4fb4-a746-9c002d1cd5f5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.190151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f404e1-13e1-4fb4-a746-9c002d1cd5f5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.194989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1d7ae-c9c8-44ae-94a3-14bc55f3ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.195601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1d7ae-c9c8-44ae-94a3-14bc55f3ca8f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.195889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1d7ae-c9c8-44ae-94a3-14bc55f3ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.196174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1d7ae-c9c8-44ae-94a3-14bc55f3ca8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.196874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1d7ae-c9c8-44ae-94a3-14bc55f3ca8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.198458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1d7ae-c9c8-44ae-94a3-14bc55f3ca8f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.208246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 897/1778] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:24.209125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1d7ae-c9c8-44ae-94a3-14bc55f3ca8f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.217608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d5772fa5964552be409123291b6372', 'request_id': 'req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:24.218854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1d7ae-c9c8-44ae-94a3-14bc55f3ca8f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.223518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b8a02-271b-40fb-8a0b-05c576ef93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.224381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b8a02-271b-40fb-8a0b-05c576ef93f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.224952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b8a02-271b-40fb-8a0b-05c576ef93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.224952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b8a02-271b-40fb-8a0b-05c576ef93f2 admin admin] PATH_INFO: `/v3/projects/48573b1be26f4990b1318b337d5273df/users/16e9457ee3064ad685e9182a28c24b7c/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.230794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] The token cache is being invalidate because project 12d5772fa5964552be409123291b6372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:24.231331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:24.231816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:24.233395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 882/1779] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:23 2022] DELETE /identity/v3/projects/12d5772fa5964552be409123291b6372 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:24.234163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.237298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:24.243835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b8a02-271b-40fb-8a0b-05c576ef93f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48573b1be26f4990b1318b337d5273df, user_id=16e9457ee3064ad685e9182a28c24b7c, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.246782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b8a02-271b-40fb-8a0b-05c576ef93f2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.247728 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924e15a-6e8e-4ccb-96cc-a43188b3d46a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.252308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464c7da-ed62-4cea-8750-bb0f601dd802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.252956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464c7da-ed62-4cea-8750-bb0f601dd802 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.253237 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464c7da-ed62-4cea-8750-bb0f601dd802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.253522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464c7da-ed62-4cea-8750-bb0f601dd802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.254242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464c7da-ed62-4cea-8750-bb0f601dd802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.255872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464c7da-ed62-4cea-8750-bb0f601dd802 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.267461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 883/1780] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:24.268976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e471bb1-64bc-4883-a718-c5e0fbb002f3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.269270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e471bb1-64bc-4883-a718-c5e0fbb002f3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.271164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e471bb1-64bc-4883-a718-c5e0fbb002f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.287427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6e471bb1-64bc-4883-a718-c5e0fbb002f3 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:24.288618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6e471bb1-64bc-4883-a718-c5e0fbb002f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:24.297062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 884/1781] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:24.297958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e471bb1-64bc-4883-a718-c5e0fbb002f3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.307415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e471bb1-64bc-4883-a718-c5e0fbb002f3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.312134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfda10-bd75-4490-b1ba-d35bbf92c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.312989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfda10-bd75-4490-b1ba-d35bbf92c5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.313274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfda10-bd75-4490-b1ba-d35bbf92c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.313550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfda10-bd75-4490-b1ba-d35bbf92c5d9 admin admin] PATH_INFO: `/v3/projects/21134bc7bf514754aeec18d8d6ffa512/users/735203cd1418470bb81739902cce6a8e/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.328364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfda10-bd75-4490-b1ba-d35bbf92c5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21134bc7bf514754aeec18d8d6ffa512, user_id=735203cd1418470bb81739902cce6a8e, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.331034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfda10-bd75-4490-b1ba-d35bbf92c5d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.375970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 898/1782] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:24 2022] PUT /identity/v3/projects/48573b1be26f4990b1318b337d5273df/users/16e9457ee3064ad685e9182a28c24b7c/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:24.377353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94597e2-3be0-477c-ba76-9a62142a4d9d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.377644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94597e2-3be0-477c-ba76-9a62142a4d9d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.377918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94597e2-3be0-477c-ba76-9a62142a4d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.395843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f94597e2-3be0-477c-ba76-9a62142a4d9d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:24.397389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f94597e2-3be0-477c-ba76-9a62142a4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:24.423602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 885/1783] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:24 2022] PUT /identity/v3/projects/21134bc7bf514754aeec18d8d6ffa512/users/735203cd1418470bb81739902cce6a8e/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:24.425196 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be1f5-4106-4496-9482-a3c7ce0b777f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.425630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be1f5-4106-4496-9482-a3c7ce0b777f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.426047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586be1f5-4106-4496-9482-a3c7ce0b777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.457474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-586be1f5-4106-4496-9482-a3c7ce0b777f None None] MFA Rules not processed for user `16e9457ee3064ad685e9182a28c24b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:24.459325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-586be1f5-4106-4496-9482-a3c7ce0b777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:24.475154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 899/1784] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:24.476805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757f8a-bddc-423c-a8fd-ac5c9d9234d6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.477271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757f8a-bddc-423c-a8fd-ac5c9d9234d6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.478208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757f8a-bddc-423c-a8fd-ac5c9d9234d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.515800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5e757f8a-bddc-423c-a8fd-ac5c9d9234d6 None None] MFA Rules not processed for user `735203cd1418470bb81739902cce6a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:24.517025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5e757f8a-bddc-423c-a8fd-ac5c9d9234d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:24.563688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 886/1785] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:24 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:24.563688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be1f5-4106-4496-9482-a3c7ce0b777f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.615887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 900/1786] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:24.616852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757f8a-bddc-423c-a8fd-ac5c9d9234d6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.618330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5e757f8a-bddc-423c-a8fd-ac5c9d9234d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:24.630586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586be1f5-4106-4496-9482-a3c7ce0b777f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.636331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f6a8-448d-4834-ab9e-6b0ece50cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.637350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757f8a-bddc-423c-a8fd-ac5c9d9234d6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.638208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f6a8-448d-4834-ab9e-6b0ece50cd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.638208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f6a8-448d-4834-ab9e-6b0ece50cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.639299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f6a8-448d-4834-ab9e-6b0ece50cd68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.641860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f6a8-448d-4834-ab9e-6b0ece50cd68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:24.642564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f6a8-448d-4834-ab9e-6b0ece50cd68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.643248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7ae4d-212f-4b79-8d55-8becd17e2b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.644134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7ae4d-212f-4b79-8d55-8becd17e2b22 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.644560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7ae4d-212f-4b79-8d55-8becd17e2b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.644944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7ae4d-212f-4b79-8d55-8becd17e2b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.645566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f6a8-448d-4834-ab9e-6b0ece50cd68 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.645917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7ae4d-212f-4b79-8d55-8becd17e2b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.648492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7ae4d-212f-4b79-8d55-8becd17e2b22 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.675708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 887/1787] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:24.676817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f6a8-448d-4834-ab9e-6b0ece50cd68 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.689922 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f6a8-448d-4834-ab9e-6b0ece50cd68 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.695374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9eb8f-1ae6-4aff-a36f-7b86274e8bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.697030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9eb8f-1ae6-4aff-a36f-7b86274e8bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.697459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9eb8f-1ae6-4aff-a36f-7b86274e8bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.698500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9eb8f-1ae6-4aff-a36f-7b86274e8bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.699555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9eb8f-1ae6-4aff-a36f-7b86274e8bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.701797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9eb8f-1ae6-4aff-a36f-7b86274e8bb0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.752231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 901/1788] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:24 2022] POST /identity/v3/projects => generated 355 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:24.753376 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7ae4d-212f-4b79-8d55-8becd17e2b22 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.812654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 888/1789] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:24 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:24.813888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9eb8f-1ae6-4aff-a36f-7b86274e8bb0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:24.844503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7ae4d-212f-4b79-8d55-8becd17e2b22 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.902287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9eb8f-1ae6-4aff-a36f-7b86274e8bb0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:24.907517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4f650-136b-4547-b857-39a4d2fbc482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.908193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4f650-136b-4547-b857-39a4d2fbc482 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.908477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4f650-136b-4547-b857-39a4d2fbc482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.908759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4f650-136b-4547-b857-39a4d2fbc482 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.909448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4f650-136b-4547-b857-39a4d2fbc482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.911442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4f650-136b-4547-b857-39a4d2fbc482 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.917363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefa6d7-ccd3-414a-883d-07dcd6054a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:24.918026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa6d7-ccd3-414a-883d-07dcd6054a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:24.918307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa6d7-ccd3-414a-883d-07dcd6054a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:24.918579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa6d7-ccd3-414a-883d-07dcd6054a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:24.919289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefa6d7-ccd3-414a-883d-07dcd6054a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:24.921157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefa6d7-ccd3-414a-883d-07dcd6054a3e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:24.950129 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:25.019084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 889/1790] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:24 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:25.019084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4f650-136b-4547-b857-39a4d2fbc482 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.027958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4f650-136b-4547-b857-39a4d2fbc482 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.033002 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22834-aedb-4319-b711-eb43ebe9ee41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.033680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22834-aedb-4319-b711-eb43ebe9ee41 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.033966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22834-aedb-4319-b711-eb43ebe9ee41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.034297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed22834-aedb-4319-b711-eb43ebe9ee41 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.035020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed22834-aedb-4319-b711-eb43ebe9ee41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.037012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed22834-aedb-4319-b711-eb43ebe9ee41 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.056607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 902/1791] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:24 2022] POST /identity/v3/projects => generated 379 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:25.058224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefa6d7-ccd3-414a-883d-07dcd6054a3e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.132852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 890/1792] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:25 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:25.133748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22834-aedb-4319-b711-eb43ebe9ee41 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.136445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefa6d7-ccd3-414a-883d-07dcd6054a3e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.141302 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03e651-d12c-4570-870d-6c8b94dabc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.141974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03e651-d12c-4570-870d-6c8b94dabc0a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.142263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03e651-d12c-4570-870d-6c8b94dabc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.142536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03e651-d12c-4570-870d-6c8b94dabc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.143303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03e651-d12c-4570-870d-6c8b94dabc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.143941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed22834-aedb-4319-b711-eb43ebe9ee41 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.144890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03e651-d12c-4570-870d-6c8b94dabc0a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.148572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11e95-72e1-49b7-b71e-6055ef3c8eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.149345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11e95-72e1-49b7-b71e-6055ef3c8eab admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.149614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11e95-72e1-49b7-b71e-6055ef3c8eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.149892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11e95-72e1-49b7-b71e-6055ef3c8eab admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.150633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da11e95-72e1-49b7-b71e-6055ef3c8eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.153277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da11e95-72e1-49b7-b71e-6055ef3c8eab admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.156366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 903/1793] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:25.157219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03e651-d12c-4570-870d-6c8b94dabc0a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.178186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03e651-d12c-4570-870d-6c8b94dabc0a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.192179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a46eab-63df-4714-80c9-d3bf805a1290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.192924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a46eab-63df-4714-80c9-d3bf805a1290 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.193212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a46eab-63df-4714-80c9-d3bf805a1290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.193506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a46eab-63df-4714-80c9-d3bf805a1290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.194228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a46eab-63df-4714-80c9-d3bf805a1290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.195918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a46eab-63df-4714-80c9-d3bf805a1290 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.211590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 904/1794] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:25.212708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a46eab-63df-4714-80c9-d3bf805a1290 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.224431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a46eab-63df-4714-80c9-d3bf805a1290 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.231116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205e609-d540-4dc2-b751-2f0beceb6099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.232432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205e609-d540-4dc2-b751-2f0beceb6099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.232822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205e609-d540-4dc2-b751-2f0beceb6099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.233338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205e609-d540-4dc2-b751-2f0beceb6099 admin admin] PATH_INFO: `/v3/projects/80e4eeca8285406c923f3e7b489fab8b/users/6dca8278de574d4b982957f6de19b227/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.239537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 891/1795] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:25 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:25.239537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11e95-72e1-49b7-b71e-6055ef3c8eab admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.250837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205e609-d540-4dc2-b751-2f0beceb6099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e4eeca8285406c923f3e7b489fab8b, user_id=6dca8278de574d4b982957f6de19b227, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.251130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11e95-72e1-49b7-b71e-6055ef3c8eab admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.253758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205e609-d540-4dc2-b751-2f0beceb6099 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.274784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1949f-c05f-427b-9340-100f6c583ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.275758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1949f-c05f-427b-9340-100f6c583ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.276079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1949f-c05f-427b-9340-100f6c583ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.276358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1949f-c05f-427b-9340-100f6c583ee2 admin admin] PATH_INFO: `/v3/projects/e67901aaa03e4465b86bd38fcc8a9cd8/users/98853e89f186437a8cc8f7029ae0a4b6/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.296771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1949f-c05f-427b-9340-100f6c583ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67901aaa03e4465b86bd38fcc8a9cd8, user_id=98853e89f186437a8cc8f7029ae0a4b6, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.299729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1949f-c05f-427b-9340-100f6c583ee2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.398606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 905/1796] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:25 2022] PUT /identity/v3/projects/80e4eeca8285406c923f3e7b489fab8b/users/6dca8278de574d4b982957f6de19b227/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:25.399478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205e609-d540-4dc2-b751-2f0beceb6099 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.422898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 892/1797] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:25 2022] PUT /identity/v3/projects/e67901aaa03e4465b86bd38fcc8a9cd8/users/98853e89f186437a8cc8f7029ae0a4b6/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:25.423861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1949f-c05f-427b-9340-100f6c583ee2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.483693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205e609-d540-4dc2-b751-2f0beceb6099 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.514941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1949f-c05f-427b-9340-100f6c583ee2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.520056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02051a9-e320-4268-a8d8-240f1d9d72ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.520779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02051a9-e320-4268-a8d8-240f1d9d72ba admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.521090 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02051a9-e320-4268-a8d8-240f1d9d72ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.521507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02051a9-e320-4268-a8d8-240f1d9d72ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.522117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02051a9-e320-4268-a8d8-240f1d9d72ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.524770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02051a9-e320-4268-a8d8-240f1d9d72ba admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.538785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 893/1798] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:25.539775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02051a9-e320-4268-a8d8-240f1d9d72ba admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.552810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02051a9-e320-4268-a8d8-240f1d9d72ba admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.558441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a74ffa-e86a-414d-8041-82d859ab9ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.559254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74ffa-e86a-414d-8041-82d859ab9ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.559779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74ffa-e86a-414d-8041-82d859ab9ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.568465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74ffa-e86a-414d-8041-82d859ab9ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.568610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b5b88-b6a1-4f9f-b178-6df365d98cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.568720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a74ffa-e86a-414d-8041-82d859ab9ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.568831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b5b88-b6a1-4f9f-b178-6df365d98cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.568831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b5b88-b6a1-4f9f-b178-6df365d98cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.568831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b5b88-b6a1-4f9f-b178-6df365d98cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.568831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b5b88-b6a1-4f9f-b178-6df365d98cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.569125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a74ffa-e86a-414d-8041-82d859ab9ce8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.569204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b5b88-b6a1-4f9f-b178-6df365d98cd6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.577298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 894/1799] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:25.578140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 906/1800] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:25.578379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a74ffa-e86a-414d-8041-82d859ab9ce8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.583985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b5b88-b6a1-4f9f-b178-6df365d98cd6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.590531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a74ffa-e86a-414d-8041-82d859ab9ce8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.596821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd44c01-54a7-4c02-9874-edd8a8df1b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.597738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44c01-54a7-4c02-9874-edd8a8df1b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.598045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44c01-54a7-4c02-9874-edd8a8df1b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.598144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b5b88-b6a1-4f9f-b178-6df365d98cd6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.598316 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44c01-54a7-4c02-9874-edd8a8df1b7f admin admin] PATH_INFO: `/v3/projects/80e4eeca8285406c923f3e7b489fab8b/users/6dca8278de574d4b982957f6de19b227/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.600360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd44c01-54a7-4c02-9874-edd8a8df1b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e4eeca8285406c923f3e7b489fab8b, user_id=6dca8278de574d4b982957f6de19b227, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.603146 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd44c01-54a7-4c02-9874-edd8a8df1b7f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.608293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd49ff-a06c-45a6-98d6-9bf72df4327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.609973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd49ff-a06c-45a6-98d6-9bf72df4327a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.610392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd49ff-a06c-45a6-98d6-9bf72df4327a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.610835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd49ff-a06c-45a6-98d6-9bf72df4327a admin admin] PATH_INFO: `/v3/projects/e67901aaa03e4465b86bd38fcc8a9cd8/users/98853e89f186437a8cc8f7029ae0a4b6/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.613535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd49ff-a06c-45a6-98d6-9bf72df4327a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67901aaa03e4465b86bd38fcc8a9cd8, user_id=98853e89f186437a8cc8f7029ae0a4b6, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.617403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd49ff-a06c-45a6-98d6-9bf72df4327a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.642386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 907/1801] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:25 2022] PUT /identity/v3/projects/e67901aaa03e4465b86bd38fcc8a9cd8/users/98853e89f186437a8cc8f7029ae0a4b6/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:25.643550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd49ff-a06c-45a6-98d6-9bf72df4327a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.654316 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 895/1802] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:25 2022] PUT /identity/v3/projects/80e4eeca8285406c923f3e7b489fab8b/users/6dca8278de574d4b982957f6de19b227/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:25.655716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95533577-2a9c-4df9-ac09-e2334deda4be None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.656064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95533577-2a9c-4df9-ac09-e2334deda4be None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.656346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95533577-2a9c-4df9-ac09-e2334deda4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.712764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-95533577-2a9c-4df9-ac09-e2334deda4be None None] MFA Rules not processed for user `98853e89f186437a8cc8f7029ae0a4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:25.718307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-95533577-2a9c-4df9-ac09-e2334deda4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:25.792646 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd49ff-a06c-45a6-98d6-9bf72df4327a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.809419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205dc75-8395-41f7-8514-976a5c444717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.810167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205dc75-8395-41f7-8514-976a5c444717 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.810675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205dc75-8395-41f7-8514-976a5c444717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.810968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205dc75-8395-41f7-8514-976a5c444717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.811725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205dc75-8395-41f7-8514-976a5c444717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.813366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205dc75-8395-41f7-8514-976a5c444717 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:25.829443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 908/1803] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:25.830702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e2b6-8ce9-44c3-83a5-d60b1eb20f97 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.831062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e2b6-8ce9-44c3-83a5-d60b1eb20f97 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.831354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e2b6-8ce9-44c3-83a5-d60b1eb20f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.872063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 896/1804] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:25.873078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95533577-2a9c-4df9-ac09-e2334deda4be None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:25.889762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-af30e2b6-8ce9-44c3-83a5-d60b1eb20f97 None None] MFA Rules not processed for user `6dca8278de574d4b982957f6de19b227`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:25.892175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-af30e2b6-8ce9-44c3-83a5-d60b1eb20f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:25.898468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95533577-2a9c-4df9-ac09-e2334deda4be None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:25.906654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780b658-17e4-4ef8-a2f8-2a78134ef515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:25.909903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:25.912894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b658-17e4-4ef8-a2f8-2a78134ef515 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:25.915335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b658-17e4-4ef8-a2f8-2a78134ef515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:25.916025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780b658-17e4-4ef8-a2f8-2a78134ef515 admin admin] PATH_INFO: `/v3/projects/19dad23c727140f98053c4689b4b08c4/users/31284ff9f34646efa361ea32a6c9e5ed/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:25.942455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780b658-17e4-4ef8-a2f8-2a78134ef515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19dad23c727140f98053c4689b4b08c4, user_id=31284ff9f34646efa361ea32a6c9e5ed, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:25.942455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780b658-17e4-4ef8-a2f8-2a78134ef515 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:26.007544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 897/1805] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:25 2022] PUT /identity/v3/projects/19dad23c727140f98053c4689b4b08c4/users/31284ff9f34646efa361ea32a6c9e5ed/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:26.008788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780b658-17e4-4ef8-a2f8-2a78134ef515 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:26.013440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d780b658-17e4-4ef8-a2f8-2a78134ef515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:26.035113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 909/1806] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:25 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:26.035113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4cdb-68b2-4b69-9a10-bf4039cc6e6b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:26.035113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4cdb-68b2-4b69-9a10-bf4039cc6e6b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:26.035113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4cdb-68b2-4b69-9a10-bf4039cc6e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:26.072385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-821f4cdb-68b2-4b69-9a10-bf4039cc6e6b None None] MFA Rules not processed for user `31284ff9f34646efa361ea32a6c9e5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:26.076137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-821f4cdb-68b2-4b69-9a10-bf4039cc6e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:26.104615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780b658-17e4-4ef8-a2f8-2a78134ef515 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:26.113354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096362b8-5974-4f98-a703-4319967ac4e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:26.114097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096362b8-5974-4f98-a703-4319967ac4e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:26.114864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096362b8-5974-4f98-a703-4319967ac4e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:26.114864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096362b8-5974-4f98-a703-4319967ac4e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:26.186079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096362b8-5974-4f98-a703-4319967ac4e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:26.187711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096362b8-5974-4f98-a703-4319967ac4e1 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:26.188455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 910/1807] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:26.192096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4cdb-68b2-4b69-9a10-bf4039cc6e6b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:26.192096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-821f4cdb-68b2-4b69-9a10-bf4039cc6e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:26.204437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4cdb-68b2-4b69-9a10-bf4039cc6e6b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:26.208186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 898/1808] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:26.209141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096362b8-5974-4f98-a703-4319967ac4e1 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:26.212963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6d316-a3ad-4637-934c-6319f4655b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:26.213790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6d316-a3ad-4637-934c-6319f4655b40 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:26.214075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6d316-a3ad-4637-934c-6319f4655b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:26.214486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6d316-a3ad-4637-934c-6319f4655b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:26.283350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096362b8-5974-4f98-a703-4319967ac4e1 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:26.288881 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b828c0-0288-4588-a4fa-1cbc5cc34893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:26.289690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b828c0-0288-4588-a4fa-1cbc5cc34893 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:26.289979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b828c0-0288-4588-a4fa-1cbc5cc34893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:26.290327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b828c0-0288-4588-a4fa-1cbc5cc34893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:26.291323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b828c0-0288-4588-a4fa-1cbc5cc34893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:26.298601 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b828c0-0288-4588-a4fa-1cbc5cc34893 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:26.308936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6d316-a3ad-4637-934c-6319f4655b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:26.310393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6d316-a3ad-4637-934c-6319f4655b40 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:26.321013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 911/1809] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:26 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:26.439255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 899/1810] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:26 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:26.443958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6d316-a3ad-4637-934c-6319f4655b40 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:26.454943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6d316-a3ad-4637-934c-6319f4655b40 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:26.539402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca6423-9554-478d-b61d-ebab3c7c15dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:26.539565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b828c0-0288-4588-a4fa-1cbc5cc34893 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:26.540282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca6423-9554-478d-b61d-ebab3c7c15dc admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:26.540581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca6423-9554-478d-b61d-ebab3c7c15dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:26.545148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca6423-9554-478d-b61d-ebab3c7c15dc admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:26.545148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca6423-9554-478d-b61d-ebab3c7c15dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:26.545148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca6423-9554-478d-b61d-ebab3c7c15dc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:26.625336 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 912/1811] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:26 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:26.626255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca6423-9554-478d-b61d-ebab3c7c15dc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:26.631819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b828c0-0288-4588-a4fa-1cbc5cc34893 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:26.636654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca6423-9554-478d-b61d-ebab3c7c15dc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:26.642773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bbc4e-2f31-47e6-b33e-3eced5dc8469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:26.643493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bbc4e-2f31-47e6-b33e-3eced5dc8469 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:26.643881 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bbc4e-2f31-47e6-b33e-3eced5dc8469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:26.644166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bbc4e-2f31-47e6-b33e-3eced5dc8469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:26.644596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96fbdd-9ab8-4e24-a40e-c302db09f95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:26.645319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96fbdd-9ab8-4e24-a40e-c302db09f95b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:26.645623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96fbdd-9ab8-4e24-a40e-c302db09f95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:26.645903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96fbdd-9ab8-4e24-a40e-c302db09f95b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:26.646719 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96fbdd-9ab8-4e24-a40e-c302db09f95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:26.648459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96fbdd-9ab8-4e24-a40e-c302db09f95b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:26.659222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 913/1812] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:26.664095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96fbdd-9ab8-4e24-a40e-c302db09f95b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:26.681028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96fbdd-9ab8-4e24-a40e-c302db09f95b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:26.690059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcdb85-2172-4914-af8a-9970497ad47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:26.691140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcdb85-2172-4914-af8a-9970497ad47c admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:26.691518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcdb85-2172-4914-af8a-9970497ad47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:26.691681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcdb85-2172-4914-af8a-9970497ad47c admin admin] PATH_INFO: `/v3/projects/611e2e960bcc447e9a219ee909bcd038/users/68d78a99d19445da83dae553bc9fe69d/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:26.719143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcdb85-2172-4914-af8a-9970497ad47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=611e2e960bcc447e9a219ee909bcd038, user_id=68d78a99d19445da83dae553bc9fe69d, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:26.729967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcdb85-2172-4914-af8a-9970497ad47c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:26.732312 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bbc4e-2f31-47e6-b33e-3eced5dc8469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:26.734852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bbc4e-2f31-47e6-b33e-3eced5dc8469 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:26.745956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 900/1813] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:26.752614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:26.836257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 914/1814] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:26 2022] PUT /identity/v3/projects/611e2e960bcc447e9a219ee909bcd038/users/68d78a99d19445da83dae553bc9fe69d/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:26.840503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bbc4e-2f31-47e6-b33e-3eced5dc8469 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:26.852397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bbc4e-2f31-47e6-b33e-3eced5dc8469 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:26.967123 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e6d23-5c12-42de-83ae-9d554d1c66d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:26.967651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e6d23-5c12-42de-83ae-9d554d1c66d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:26.968041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e6d23-5c12-42de-83ae-9d554d1c66d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:26.968515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e6d23-5c12-42de-83ae-9d554d1c66d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:26.969743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e6d23-5c12-42de-83ae-9d554d1c66d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:26.974112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e6d23-5c12-42de-83ae-9d554d1c66d3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:27.001343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 901/1815] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:27.003295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcdb85-2172-4914-af8a-9970497ad47c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:27.029827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcdb85-2172-4914-af8a-9970497ad47c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:27.065131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39cd6e-95d7-4297-b2f7-bf85113b09ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:27.068029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39cd6e-95d7-4297-b2f7-bf85113b09ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:27.068029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39cd6e-95d7-4297-b2f7-bf85113b09ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:27.068029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39cd6e-95d7-4297-b2f7-bf85113b09ef admin admin] PATH_INFO: `/v3/projects/611e2e960bcc447e9a219ee909bcd038/users/68d78a99d19445da83dae553bc9fe69d/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:27.077096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39cd6e-95d7-4297-b2f7-bf85113b09ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=611e2e960bcc447e9a219ee909bcd038, user_id=68d78a99d19445da83dae553bc9fe69d, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:27.086281 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39cd6e-95d7-4297-b2f7-bf85113b09ef admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:27.131696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e6d23-5c12-42de-83ae-9d554d1c66d3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:27.136013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 915/1816] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:27 2022] PUT /identity/v3/projects/611e2e960bcc447e9a219ee909bcd038/users/68d78a99d19445da83dae553bc9fe69d/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:27.149306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927446f0-d6f0-449c-8a8d-aea79afa11e6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:27.158974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927446f0-d6f0-449c-8a8d-aea79afa11e6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:27.160974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927446f0-d6f0-449c-8a8d-aea79afa11e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:27.257783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-927446f0-d6f0-449c-8a8d-aea79afa11e6 None None] MFA Rules not processed for user `68d78a99d19445da83dae553bc9fe69d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:27.257783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-927446f0-d6f0-449c-8a8d-aea79afa11e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:27.268232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e6d23-5c12-42de-83ae-9d554d1c66d3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:27.472815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f10c39-6241-4916-9ce7-f4f203ef80f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:27.472815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f10c39-6241-4916-9ce7-f4f203ef80f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:27.472815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f10c39-6241-4916-9ce7-f4f203ef80f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:27.472815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f10c39-6241-4916-9ce7-f4f203ef80f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:27.508861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 916/1817] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:27.655485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f10c39-6241-4916-9ce7-f4f203ef80f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:27.659013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f10c39-6241-4916-9ce7-f4f203ef80f0 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:27.693975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 902/1818] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:27 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:27.727025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:27.878757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927446f0-d6f0-449c-8a8d-aea79afa11e6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:27.888337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927446f0-d6f0-449c-8a8d-aea79afa11e6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:27.899611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c125ad1-350d-415b-a2b3-adbd4ea699b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:27.900319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c125ad1-350d-415b-a2b3-adbd4ea699b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:27.900563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c125ad1-350d-415b-a2b3-adbd4ea699b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:27.900834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c125ad1-350d-415b-a2b3-adbd4ea699b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:27.929725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c125ad1-350d-415b-a2b3-adbd4ea699b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:27.931368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c125ad1-350d-415b-a2b3-adbd4ea699b1 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:27.943862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 917/1819] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:28.397805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f10c39-6241-4916-9ce7-f4f203ef80f0 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:28.413873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f10c39-6241-4916-9ce7-f4f203ef80f0 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:28.442643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e4208-679e-4e10-af14-5cac43e34e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:28.443544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e4208-679e-4e10-af14-5cac43e34e2a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:28.443831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e4208-679e-4e10-af14-5cac43e34e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:28.445641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e4208-679e-4e10-af14-5cac43e34e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:28.570959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e4208-679e-4e10-af14-5cac43e34e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:28.573337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e4208-679e-4e10-af14-5cac43e34e2a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:28.584631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 903/1820] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:28.777529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851492b-a546-4a0c-935d-9affcb7ba24b None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:28.778060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851492b-a546-4a0c-935d-9affcb7ba24b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:28.778060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851492b-a546-4a0c-935d-9affcb7ba24b None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:28.779585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 918/1821] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:28.790912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864c49e-1110-41ae-acaf-35a11fb7f480 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:28.791847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864c49e-1110-41ae-acaf-35a11fb7f480 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:28.792213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864c49e-1110-41ae-acaf-35a11fb7f480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:28.843906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3864c49e-1110-41ae-acaf-35a11fb7f480 None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:28.845406 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3864c49e-1110-41ae-acaf-35a11fb7f480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:28.909959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:28.919734 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 904/1822] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:13:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:28.931520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851492b-a546-4a0c-935d-9affcb7ba24b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:28.933281 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1851492b-a546-4a0c-935d-9affcb7ba24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:28.958233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851492b-a546-4a0c-935d-9affcb7ba24b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:28.964751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34d17f-0bcd-4004-93b4-11445fdd49b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:28.965399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d17f-0bcd-4004-93b4-11445fdd49b9 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:28.965670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d17f-0bcd-4004-93b4-11445fdd49b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:28.965947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d17f-0bcd-4004-93b4-11445fdd49b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:28.975244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34d17f-0bcd-4004-93b4-11445fdd49b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:28.976897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34d17f-0bcd-4004-93b4-11445fdd49b9 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:28.987664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 919/1823] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:30.375354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:30.718227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:31.585755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864c49e-1110-41ae-acaf-35a11fb7f480 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:31.587187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3864c49e-1110-41ae-acaf-35a11fb7f480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:31.655208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864c49e-1110-41ae-acaf-35a11fb7f480 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:31.659374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:31.660405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.660779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.661148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] PATH_INFO: `/v3/users/b8311bb6457e4d40b1b4b8f41b76585b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.662573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8311bb6457e4d40b1b4b8f41b76585b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:31.664880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:31.878116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8311bb6457e4d40b1b4b8f41b76585b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.878811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8311bb6457e4d40b1b4b8f41b76585b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.891504 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8311bb6457e4d40b1b4b8f41b76585b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.898537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8311bb6457e4d40b1b4b8f41b76585b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.899279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8311bb6457e4d40b1b4b8f41b76585b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.013644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 905/1824] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:31 2022] DELETE /identity/v3/users/b8311bb6457e4d40b1b4b8f41b76585b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:32.018757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34449f-38ad-497a-a5b5-c5849394ff37 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.019250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34449f-38ad-497a-a5b5-c5849394ff37 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.019337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34449f-38ad-497a-a5b5-c5849394ff37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.037348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:32.039883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8a34449f-38ad-497a-a5b5-c5849394ff37 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:32.041662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8a34449f-38ad-497a-a5b5-c5849394ff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:32.105178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 920/1825] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:32.114776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:32.116212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:32.173515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d785e5-9b57-432e-b72a-7190242a202a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:32.176904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eb2bc-5cb7-47e0-a2c1-10f64608375d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:32.177551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eb2bc-5cb7-47e0-a2c1-10f64608375d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.177832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eb2bc-5cb7-47e0-a2c1-10f64608375d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.178103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eb2bc-5cb7-47e0-a2c1-10f64608375d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.187651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eb2bc-5cb7-47e0-a2c1-10f64608375d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:32.189067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eb2bc-5cb7-47e0-a2c1-10f64608375d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:32.199301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 906/1826] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:32.475807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:33.585826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34449f-38ad-497a-a5b5-c5849394ff37 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:33.587438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8a34449f-38ad-497a-a5b5-c5849394ff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:33.622966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34449f-38ad-497a-a5b5-c5849394ff37 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:33.637125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:33.638311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:33.639361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:33.639869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] PATH_INFO: `/v3/projects/60ee3c495ce54612b586fb3f6f0df53f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:33.642175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ee3c495ce54612b586fb3f6f0df53f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:33.644197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:33.823693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ee3c495ce54612b586fb3f6f0df53f', 'request_id': 'req-9f68f756-40c3-4047-9681-7be639c9bd1b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:33.832777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ee3c495ce54612b586fb3f6f0df53f', 'request_id': 'req-9f68f756-40c3-4047-9681-7be639c9bd1b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:33.921042 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ee3c495ce54612b586fb3f6f0df53f', 'request_id': 'req-9f68f756-40c3-4047-9681-7be639c9bd1b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:33.937364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] The token cache is being invalidate because project 60ee3c495ce54612b586fb3f6f0df53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:33.938447 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:33.939623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:33.942103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 921/1827] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:33 2022] DELETE /identity/v3/projects/60ee3c495ce54612b586fb3f6f0df53f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:33.946014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eb2bc-5cb7-47e0-a2c1-10f64608375d service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:33.956744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eb2bc-5cb7-47e0-a2c1-10f64608375d service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:34.045969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:34.045969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:34.045969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:34.045969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] PATH_INFO: `/v3/users/9cb1a2303ce743b6853cea75758d5fd9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:34.046474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb1a2303ce743b6853cea75758d5fd9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:34.047620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:34.163716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:34.163716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:34.169382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68f756-40c3-4047-9681-7be639c9bd1b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:34.176205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:34.177430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:34.178058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:34.178532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] PATH_INFO: `/v3/users/735203cd1418470bb81739902cce6a8e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:34.180273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=735203cd1418470bb81739902cce6a8e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:34.183286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:34.295880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb1a2303ce743b6853cea75758d5fd9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.297009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb1a2303ce743b6853cea75758d5fd9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.315721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb1a2303ce743b6853cea75758d5fd9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.324104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb1a2303ce743b6853cea75758d5fd9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.325150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3b45fad0-36f9-4627-8bf3-c1631160fb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb1a2303ce743b6853cea75758d5fd9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.453840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 907/1828] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:33 2022] DELETE /identity/v3/users/9cb1a2303ce743b6853cea75758d5fd9 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:34.467932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735203cd1418470bb81739902cce6a8e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.468902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735203cd1418470bb81739902cce6a8e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.470181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735203cd1418470bb81739902cce6a8e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.492666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735203cd1418470bb81739902cce6a8e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.507278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735203cd1418470bb81739902cce6a8e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.664399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:34.672113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 922/1829] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:34 2022] DELETE /identity/v3/users/735203cd1418470bb81739902cce6a8e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:34.677707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b281d-67ae-4a23-afc3-fd7eb4a0f7a4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:34.678457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b281d-67ae-4a23-afc3-fd7eb4a0f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:34.679454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b281d-67ae-4a23-afc3-fd7eb4a0f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:34.727721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-746b281d-67ae-4a23-afc3-fd7eb4a0f7a4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:34.730383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-746b281d-67ae-4a23-afc3-fd7eb4a0f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:34.813846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 908/1830] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:34.824077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:34.825959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:34.868247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:34.908927 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a492af-b2ba-46b4-9092-fe2730f2b5bd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:34.912496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c28ce-1fd8-4e41-9341-3615dab7b8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:34.913145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c28ce-1fd8-4e41-9341-3615dab7b8fb service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:34.913426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c28ce-1fd8-4e41-9341-3615dab7b8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:34.913697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c28ce-1fd8-4e41-9341-3615dab7b8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:34.923066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c28ce-1fd8-4e41-9341-3615dab7b8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:34.924559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c28ce-1fd8-4e41-9341-3615dab7b8fb service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:34.934328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 923/1831] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:35.028904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b281d-67ae-4a23-afc3-fd7eb4a0f7a4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.030997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-746b281d-67ae-4a23-afc3-fd7eb4a0f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:35.043318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b281d-67ae-4a23-afc3-fd7eb4a0f7a4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.049687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.050774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.051247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.051544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] PATH_INFO: `/v3/projects/01b59d8de2294a28b6968d7799332bf3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.052747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b59d8de2294a28b6968d7799332bf3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.054677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.187166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b59d8de2294a28b6968d7799332bf3', 'request_id': 'req-f5ca73ec-ad80-4527-9828-54de0b166f5b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.193808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b59d8de2294a28b6968d7799332bf3', 'request_id': 'req-f5ca73ec-ad80-4527-9828-54de0b166f5b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.269117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b59d8de2294a28b6968d7799332bf3', 'request_id': 'req-f5ca73ec-ad80-4527-9828-54de0b166f5b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.280933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] The token cache is being invalidate because project 01b59d8de2294a28b6968d7799332bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:35.281229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.286746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f5ca73ec-ad80-4527-9828-54de0b166f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.286746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 909/1832] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:35 2022] DELETE /identity/v3/projects/01b59d8de2294a28b6968d7799332bf3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:35.288416 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a6cb-8002-4b23-939e-8c05715df871 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.288713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a6cb-8002-4b23-939e-8c05715df871 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.288992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a6cb-8002-4b23-939e-8c05715df871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.306877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0a30a6cb-8002-4b23-939e-8c05715df871 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:35.308629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0a30a6cb-8002-4b23-939e-8c05715df871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:35.367229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 924/1833] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:35.377324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d80b3-dff5-4c47-9e8f-301fdb0e33a0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.377640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d80b3-dff5-4c47-9e8f-301fdb0e33a0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.377919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d80b3-dff5-4c47-9e8f-301fdb0e33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.396402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fe2d80b3-dff5-4c47-9e8f-301fdb0e33a0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:35.397610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe2d80b3-dff5-4c47-9e8f-301fdb0e33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:35.405438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 910/1834] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:35.409657 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30a6cb-8002-4b23-939e-8c05715df871 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.419348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30a6cb-8002-4b23-939e-8c05715df871 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.423880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599d936-7691-4fd0-bdf5-56ccffb75292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.424537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599d936-7691-4fd0-bdf5-56ccffb75292 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.424817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599d936-7691-4fd0-bdf5-56ccffb75292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.425091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599d936-7691-4fd0-bdf5-56ccffb75292 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.425807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599d936-7691-4fd0-bdf5-56ccffb75292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:35.426115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599d936-7691-4fd0-bdf5-56ccffb75292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.427728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599d936-7691-4fd0-bdf5-56ccffb75292 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.440035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 925/1835] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:35.440180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d80b3-dff5-4c47-9e8f-301fdb0e33a0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.441816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fe2d80b3-dff5-4c47-9e8f-301fdb0e33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:35.444021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599d936-7691-4fd0-bdf5-56ccffb75292 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.455343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599d936-7691-4fd0-bdf5-56ccffb75292 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.455874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d80b3-dff5-4c47-9e8f-301fdb0e33a0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.460332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beece9-5a39-4f8d-ba47-850a8bd4c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.460794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.464400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beece9-5a39-4f8d-ba47-850a8bd4c3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.464400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beece9-5a39-4f8d-ba47-850a8bd4c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.464400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beece9-5a39-4f8d-ba47-850a8bd4c3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.464683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.464683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.464683 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] PATH_INFO: `/v3/projects/21134bc7bf514754aeec18d8d6ffa512` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.464894 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beece9-5a39-4f8d-ba47-850a8bd4c3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.464963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21134bc7bf514754aeec18d8d6ffa512)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.465034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beece9-5a39-4f8d-ba47-850a8bd4c3f2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.467201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.588238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 926/1836] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:35 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:35.591992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beece9-5a39-4f8d-ba47-850a8bd4c3f2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.607977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21134bc7bf514754aeec18d8d6ffa512', 'request_id': 'req-ff82a557-b667-48f4-9c8c-8b326f6e1e81'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.614533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21134bc7bf514754aeec18d8d6ffa512', 'request_id': 'req-ff82a557-b667-48f4-9c8c-8b326f6e1e81'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.652002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beece9-5a39-4f8d-ba47-850a8bd4c3f2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.686043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21134bc7bf514754aeec18d8d6ffa512', 'request_id': 'req-ff82a557-b667-48f4-9c8c-8b326f6e1e81'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.696995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] The token cache is being invalidate because project 21134bc7bf514754aeec18d8d6ffa512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:35.697361 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.698040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.699781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 911/1837] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:35 2022] DELETE /identity/v3/projects/21134bc7bf514754aeec18d8d6ffa512 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:35.703660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.704931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:35.705820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94cb70-c14f-4319-80f3-dc694d708219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.706621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94cb70-c14f-4319-80f3-dc694d708219 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.706906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94cb70-c14f-4319-80f3-dc694d708219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.707206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94cb70-c14f-4319-80f3-dc694d708219 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.707921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94cb70-c14f-4319-80f3-dc694d708219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.709842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94cb70-c14f-4319-80f3-dc694d708219 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.717345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a557-b667-48f4-9c8c-8b326f6e1e81 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.721986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.722846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.723156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.723432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] PATH_INFO: `/v3/users/98853e89f186437a8cc8f7029ae0a4b6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.726878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98853e89f186437a8cc8f7029ae0a4b6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.726878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.841902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 927/1838] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:35 2022] POST /identity/v3/users => generated 282 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:35.843678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94cb70-c14f-4319-80f3-dc694d708219 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.845327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ab94cb70-c14f-4319-80f3-dc694d708219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:35.857512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94cb70-c14f-4319-80f3-dc694d708219 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.862184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c38a7-f46c-4975-99aa-4473d6c996a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.862844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c38a7-f46c-4975-99aa-4473d6c996a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.863152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c38a7-f46c-4975-99aa-4473d6c996a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.863429 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c38a7-f46c-4975-99aa-4473d6c996a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.864156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c38a7-f46c-4975-99aa-4473d6c996a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.865728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c38a7-f46c-4975-99aa-4473d6c996a2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.880726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 928/1839] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:35.884088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c38a7-f46c-4975-99aa-4473d6c996a2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.894350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c38a7-f46c-4975-99aa-4473d6c996a2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.903347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba131503-9ca7-4fe5-be07-23fed8407720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.903990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba131503-9ca7-4fe5-be07-23fed8407720 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.904352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba131503-9ca7-4fe5-be07-23fed8407720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.904618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba131503-9ca7-4fe5-be07-23fed8407720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.905337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba131503-9ca7-4fe5-be07-23fed8407720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.907028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba131503-9ca7-4fe5-be07-23fed8407720 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.918647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 929/1840] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:35.923265 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba131503-9ca7-4fe5-be07-23fed8407720 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.933571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba131503-9ca7-4fe5-be07-23fed8407720 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.938487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98853e89f186437a8cc8f7029ae0a4b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.939279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98853e89f186437a8cc8f7029ae0a4b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.939392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f912d2-74dd-4f0c-96f2-7ec04417b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.941617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f912d2-74dd-4f0c-96f2-7ec04417b591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.941617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f912d2-74dd-4f0c-96f2-7ec04417b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.941617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f912d2-74dd-4f0c-96f2-7ec04417b591 admin admin] PATH_INFO: `/v3/projects/65a1d744979046419c260654552eb878/users/977ec278107141fd93f8ff749b6cc045/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.953352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98853e89f186437a8cc8f7029ae0a4b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.956531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f912d2-74dd-4f0c-96f2-7ec04417b591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a1d744979046419c260654552eb878, user_id=977ec278107141fd93f8ff749b6cc045, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.959247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f912d2-74dd-4f0c-96f2-7ec04417b591 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.960765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98853e89f186437a8cc8f7029ae0a4b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:35.961384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98853e89f186437a8cc8f7029ae0a4b6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:36.001178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:36.035015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 930/1841] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:35 2022] PUT /identity/v3/projects/65a1d744979046419c260654552eb878/users/977ec278107141fd93f8ff749b6cc045/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:36.035236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 912/1842] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:35 2022] DELETE /identity/v3/users/98853e89f186437a8cc8f7029ae0a4b6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:36.046064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960abd6b-9eac-491c-9ab5-33f445af819b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.046461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960abd6b-9eac-491c-9ab5-33f445af819b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.046837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960abd6b-9eac-491c-9ab5-33f445af819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.075062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-960abd6b-9eac-491c-9ab5-33f445af819b None None] MFA Rules not processed for user `977ec278107141fd93f8ff749b6cc045`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:36.076303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-960abd6b-9eac-491c-9ab5-33f445af819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:36.144016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:36.145546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 931/1843] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:36.150258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.152294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:36.217549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56d590-6025-46e4-a710-5c49633e16d1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.222397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af435909-6e77-4884-83be-7815d6ab66ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.223055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af435909-6e77-4884-83be-7815d6ab66ba admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.224709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af435909-6e77-4884-83be-7815d6ab66ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.224709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af435909-6e77-4884-83be-7815d6ab66ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.224709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af435909-6e77-4884-83be-7815d6ab66ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.226232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af435909-6e77-4884-83be-7815d6ab66ba admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.321204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 913/1844] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:36 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:36.328756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960abd6b-9eac-491c-9ab5-33f445af819b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.340709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960abd6b-9eac-491c-9ab5-33f445af819b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.398184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad6ea4-e5c9-420b-ae0c-1a4b1ce48ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.398862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad6ea4-e5c9-420b-ae0c-1a4b1ce48ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.399171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad6ea4-e5c9-420b-ae0c-1a4b1ce48ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.399448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad6ea4-e5c9-420b-ae0c-1a4b1ce48ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.400169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad6ea4-e5c9-420b-ae0c-1a4b1ce48ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.402681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad6ea4-e5c9-420b-ae0c-1a4b1ce48ef3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.509203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 932/1845] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:36 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:36.513661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af435909-6e77-4884-83be-7815d6ab66ba admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.523961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af435909-6e77-4884-83be-7815d6ab66ba admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.529433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad6ea4-e5c9-420b-ae0c-1a4b1ce48ef3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.529807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2373168-74d8-4930-8f5b-17a70188bfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.530584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2373168-74d8-4930-8f5b-17a70188bfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.530873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2373168-74d8-4930-8f5b-17a70188bfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.531235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-74ad6ea4-e5c9-420b-ae0c-1a4b1ce48ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:36.531493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2373168-74d8-4930-8f5b-17a70188bfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.532370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2373168-74d8-4930-8f5b-17a70188bfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.534002 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2373168-74d8-4930-8f5b-17a70188bfb8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.545630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 914/1846] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:36.553043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad6ea4-e5c9-420b-ae0c-1a4b1ce48ef3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.554526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2373168-74d8-4930-8f5b-17a70188bfb8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.558757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.559897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.560182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.560452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] PATH_INFO: `/v3/projects/e67901aaa03e4465b86bd38fcc8a9cd8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.561677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e67901aaa03e4465b86bd38fcc8a9cd8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.563606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.565488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2373168-74d8-4930-8f5b-17a70188bfb8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.571935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e6bb6-618f-4736-85f8-9fb5cccb5ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.571935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e6bb6-618f-4736-85f8-9fb5cccb5ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.571935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e6bb6-618f-4736-85f8-9fb5cccb5ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.571935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e6bb6-618f-4736-85f8-9fb5cccb5ef3 admin admin] PATH_INFO: `/v3/projects/3022bdea88124811961a2a024fb1bece/users/36ad757be2914834abd93ab1013f7431/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.587834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e6bb6-618f-4736-85f8-9fb5cccb5ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3022bdea88124811961a2a024fb1bece, user_id=36ad757be2914834abd93ab1013f7431, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.591121 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e6bb6-618f-4736-85f8-9fb5cccb5ef3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.682839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:36.688460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 915/1847] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:36 2022] PUT /identity/v3/projects/3022bdea88124811961a2a024fb1bece/users/36ad757be2914834abd93ab1013f7431/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:36.692161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e6bb6-618f-4736-85f8-9fb5cccb5ef3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.694576 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e67901aaa03e4465b86bd38fcc8a9cd8', 'request_id': 'req-daf9b86a-d454-44e4-b22d-03b6eb88749c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:36.701953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e67901aaa03e4465b86bd38fcc8a9cd8', 'request_id': 'req-daf9b86a-d454-44e4-b22d-03b6eb88749c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:36.752746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e6bb6-618f-4736-85f8-9fb5cccb5ef3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.785988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e67901aaa03e4465b86bd38fcc8a9cd8', 'request_id': 'req-daf9b86a-d454-44e4-b22d-03b6eb88749c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:36.796766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] The token cache is being invalidate because project e67901aaa03e4465b86bd38fcc8a9cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:36.797055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:36.797706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-daf9b86a-d454-44e4-b22d-03b6eb88749c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:36.799297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 933/1848] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:36 2022] DELETE /identity/v3/projects/e67901aaa03e4465b86bd38fcc8a9cd8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:36.803990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ed3b7-c24a-49ac-80ec-b8befb102df4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.804277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ed3b7-c24a-49ac-80ec-b8befb102df4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.807504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ed3b7-c24a-49ac-80ec-b8befb102df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.808110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3c689-65b1-4aa4-b4ca-62ee926c2cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.808785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3c689-65b1-4aa4-b4ca-62ee926c2cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.809073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3c689-65b1-4aa4-b4ca-62ee926c2cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.809412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3c689-65b1-4aa4-b4ca-62ee926c2cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.810073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3c689-65b1-4aa4-b4ca-62ee926c2cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.811712 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3c689-65b1-4aa4-b4ca-62ee926c2cbf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.825507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 916/1849] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:36.825666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e55ed3b7-c24a-49ac-80ec-b8befb102df4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:36.825666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e55ed3b7-c24a-49ac-80ec-b8befb102df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:36.826616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3c689-65b1-4aa4-b4ca-62ee926c2cbf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.828274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0da3c689-65b1-4aa4-b4ca-62ee926c2cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:36.833276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 934/1850] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:36.842592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3c689-65b1-4aa4-b4ca-62ee926c2cbf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.843883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6155-a430-4a18-ae37-4beb1387937a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.844176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6155-a430-4a18-ae37-4beb1387937a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.844455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6155-a430-4a18-ae37-4beb1387937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.846260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02bb4f-9c3b-423b-be8b-9d2e6530eb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.847244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02bb4f-9c3b-423b-be8b-9d2e6530eb24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.847637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02bb4f-9c3b-423b-be8b-9d2e6530eb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.847917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02bb4f-9c3b-423b-be8b-9d2e6530eb24 admin admin] PATH_INFO: `/v3/projects/3022bdea88124811961a2a024fb1bece/users/36ad757be2914834abd93ab1013f7431/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.849902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02bb4f-9c3b-423b-be8b-9d2e6530eb24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3022bdea88124811961a2a024fb1bece, user_id=36ad757be2914834abd93ab1013f7431, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.855562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02bb4f-9c3b-423b-be8b-9d2e6530eb24 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.865452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-117e6155-a430-4a18-ae37-4beb1387937a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:36.866667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-117e6155-a430-4a18-ae37-4beb1387937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:36.868904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 917/1851] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:36 2022] PUT /identity/v3/projects/3022bdea88124811961a2a024fb1bece/users/36ad757be2914834abd93ab1013f7431/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:36.880181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdfb4e-62eb-43b9-bc96-518856878288 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.880510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdfb4e-62eb-43b9-bc96-518856878288 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.880748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdfb4e-62eb-43b9-bc96-518856878288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.893449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:36.912795 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-78fdfb4e-62eb-43b9-bc96-518856878288 None None] MFA Rules not processed for user `36ad757be2914834abd93ab1013f7431`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:36.916116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-78fdfb4e-62eb-43b9-bc96-518856878288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:36.943852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 935/1852] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:36.953528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e6155-a430-4a18-ae37-4beb1387937a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.963324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e6155-a430-4a18-ae37-4beb1387937a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.971009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30ee2f-0218-4704-9353-5b7880c86906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.971840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ee2f-0218-4704-9353-5b7880c86906 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.972198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ee2f-0218-4704-9353-5b7880c86906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.972551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ee2f-0218-4704-9353-5b7880c86906 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.974378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30ee2f-0218-4704-9353-5b7880c86906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:36.974915 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30ee2f-0218-4704-9353-5b7880c86906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.976453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30ee2f-0218-4704-9353-5b7880c86906 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.996155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 936/1853] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:37.000965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30ee2f-0218-4704-9353-5b7880c86906 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.003750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 918/1854] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:37.016843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdfb4e-62eb-43b9-bc96-518856878288 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.019425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-78fdfb4e-62eb-43b9-bc96-518856878288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:37.032367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30ee2f-0218-4704-9353-5b7880c86906 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.037691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231969-309a-4ddb-a97e-1fff672e5fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.038307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231969-309a-4ddb-a97e-1fff672e5fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.038590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231969-309a-4ddb-a97e-1fff672e5fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.038894 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231969-309a-4ddb-a97e-1fff672e5fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.039625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97231969-309a-4ddb-a97e-1fff672e5fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.042476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97231969-309a-4ddb-a97e-1fff672e5fc6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.086312 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdfb4e-62eb-43b9-bc96-518856878288 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.090007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504087b4-e004-4793-acfb-9a678e868a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.094824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504087b4-e004-4793-acfb-9a678e868a14 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.094824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504087b4-e004-4793-acfb-9a678e868a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.094824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504087b4-e004-4793-acfb-9a678e868a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.100315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504087b4-e004-4793-acfb-9a678e868a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.101717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504087b4-e004-4793-acfb-9a678e868a14 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.111336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 919/1855] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:37.141974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 937/1856] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:36 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:37.143162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504087b4-e004-4793-acfb-9a678e868a14 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.153822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504087b4-e004-4793-acfb-9a678e868a14 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.201296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:37.214604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b96c-7ccc-45c7-8325-316ab8b5dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.215402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b96c-7ccc-45c7-8325-316ab8b5dae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.215705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b96c-7ccc-45c7-8325-316ab8b5dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.215978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b96c-7ccc-45c7-8325-316ab8b5dae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.216801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238b96c-7ccc-45c7-8325-316ab8b5dae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.218711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238b96c-7ccc-45c7-8325-316ab8b5dae2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.333312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231969-309a-4ddb-a97e-1fff672e5fc6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.350020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 920/1857] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:37 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:37.356862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b96c-7ccc-45c7-8325-316ab8b5dae2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.367844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b96c-7ccc-45c7-8325-316ab8b5dae2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.373788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c114297-b491-4fde-b1bf-c6d33c421e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.374455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c114297-b491-4fde-b1bf-c6d33c421e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.374733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c114297-b491-4fde-b1bf-c6d33c421e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.375167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c114297-b491-4fde-b1bf-c6d33c421e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.375896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c114297-b491-4fde-b1bf-c6d33c421e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.377471 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c114297-b491-4fde-b1bf-c6d33c421e24 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.390468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 921/1858] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:37.395401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c114297-b491-4fde-b1bf-c6d33c421e24 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.398302 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231969-309a-4ddb-a97e-1fff672e5fc6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.403066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0f47d-1216-4d34-8c09-15ec561294dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.403743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0f47d-1216-4d34-8c09-15ec561294dd service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.404020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0f47d-1216-4d34-8c09-15ec561294dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.404288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0f47d-1216-4d34-8c09-15ec561294dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.406106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c114297-b491-4fde-b1bf-c6d33c421e24 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.406258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1df0f47d-1216-4d34-8c09-15ec561294dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:37.413289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3cdd7-f56f-42b7-9f2f-3ae0ffcbd25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.413959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3cdd7-f56f-42b7-9f2f-3ae0ffcbd25f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.414242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3cdd7-f56f-42b7-9f2f-3ae0ffcbd25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.414518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3cdd7-f56f-42b7-9f2f-3ae0ffcbd25f admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.415280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3cdd7-f56f-42b7-9f2f-3ae0ffcbd25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.417459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3cdd7-f56f-42b7-9f2f-3ae0ffcbd25f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.429185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 922/1859] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:37.433703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3cdd7-f56f-42b7-9f2f-3ae0ffcbd25f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.443759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3cdd7-f56f-42b7-9f2f-3ae0ffcbd25f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.451726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb36a75-942e-49a9-9134-47f905cc3a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.452703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb36a75-942e-49a9-9134-47f905cc3a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.452989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb36a75-942e-49a9-9134-47f905cc3a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.453298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb36a75-942e-49a9-9134-47f905cc3a9c admin admin] PATH_INFO: `/v3/projects/b58e431dcc0f43309fe7a8f2e75dd155/users/7d248b71668f4a588671d39cd8898187/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.470106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0f47d-1216-4d34-8c09-15ec561294dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.471279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0f47d-1216-4d34-8c09-15ec561294dd service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.471461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb36a75-942e-49a9-9134-47f905cc3a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58e431dcc0f43309fe7a8f2e75dd155, user_id=7d248b71668f4a588671d39cd8898187, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.474160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb36a75-942e-49a9-9134-47f905cc3a9c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.481615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 938/1860] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:37.589997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 923/1861] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:37 2022] PUT /identity/v3/projects/b58e431dcc0f43309fe7a8f2e75dd155/users/7d248b71668f4a588671d39cd8898187/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:37.600415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cae7f-404f-4ee4-b80c-1f8e4620e24e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.600702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cae7f-404f-4ee4-b80c-1f8e4620e24e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.600980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cae7f-404f-4ee4-b80c-1f8e4620e24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.628526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5b2cae7f-404f-4ee4-b80c-1f8e4620e24e None None] MFA Rules not processed for user `7d248b71668f4a588671d39cd8898187`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:37.629779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5b2cae7f-404f-4ee4-b80c-1f8e4620e24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:37.693142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 939/1862] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:37.697811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb36a75-942e-49a9-9134-47f905cc3a9c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.761070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb36a75-942e-49a9-9134-47f905cc3a9c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.765827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4d7f7-a2b4-4a6d-bfb1-80dbf2c9cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.766612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4d7f7-a2b4-4a6d-bfb1-80dbf2c9cc80 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.766900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4d7f7-a2b4-4a6d-bfb1-80dbf2c9cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.767214 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4d7f7-a2b4-4a6d-bfb1-80dbf2c9cc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.767939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4d7f7-a2b4-4a6d-bfb1-80dbf2c9cc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.769841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4d7f7-a2b4-4a6d-bfb1-80dbf2c9cc80 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.895911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 924/1863] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:37 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:37.899949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cae7f-404f-4ee4-b80c-1f8e4620e24e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.902080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:37.916857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cae7f-404f-4ee4-b80c-1f8e4620e24e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.991296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b083-38d2-4bbb-8581-62aa85b5e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.991979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b083-38d2-4bbb-8581-62aa85b5e2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.992264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b083-38d2-4bbb-8581-62aa85b5e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.992541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b083-38d2-4bbb-8581-62aa85b5e2c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.993250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60b083-38d2-4bbb-8581-62aa85b5e2c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.995195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60b083-38d2-4bbb-8581-62aa85b5e2c5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:38.101684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 940/1864] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:37 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:38.108362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4d7f7-a2b4-4a6d-bfb1-80dbf2c9cc80 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:38.118525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4d7f7-a2b4-4a6d-bfb1-80dbf2c9cc80 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:38.124017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297ba9-04f5-40d6-91b6-ebb002406dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:38.124705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297ba9-04f5-40d6-91b6-ebb002406dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.124988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297ba9-04f5-40d6-91b6-ebb002406dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.125260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297ba9-04f5-40d6-91b6-ebb002406dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.125982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe297ba9-04f5-40d6-91b6-ebb002406dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:38.127621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe297ba9-04f5-40d6-91b6-ebb002406dbb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:38.138823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 925/1865] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:38.143808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b083-38d2-4bbb-8581-62aa85b5e2c5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:38.154377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b083-38d2-4bbb-8581-62aa85b5e2c5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:38.159066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57476-379a-45ce-ab51-374998e3e9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:38.164379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57476-379a-45ce-ab51-374998e3e9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.164379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57476-379a-45ce-ab51-374998e3e9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.164379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57476-379a-45ce-ab51-374998e3e9c5 admin admin] PATH_INFO: `/v3/projects/f5fe2b3fd3b0477a831a6a90c42d5bc4/users/8cacf7aedfdc4526b436eae3824371bb/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.177104 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57476-379a-45ce-ab51-374998e3e9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fe2b3fd3b0477a831a6a90c42d5bc4, user_id=8cacf7aedfdc4526b436eae3824371bb, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:38.179843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57476-379a-45ce-ab51-374998e3e9c5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:38.212403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:38.275316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 941/1866] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:38 2022] PUT /identity/v3/projects/f5fe2b3fd3b0477a831a6a90c42d5bc4/users/8cacf7aedfdc4526b436eae3824371bb/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:38.281244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297ba9-04f5-40d6-91b6-ebb002406dbb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:38.291088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297ba9-04f5-40d6-91b6-ebb002406dbb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:38.353839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b0e6b-933b-403b-8ff3-1c4ed681d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:38.354753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b0e6b-933b-403b-8ff3-1c4ed681d97e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.355038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b0e6b-933b-403b-8ff3-1c4ed681d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.355348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b0e6b-933b-403b-8ff3-1c4ed681d97e admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.356096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b0e6b-933b-403b-8ff3-1c4ed681d97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:38.357755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b0e6b-933b-403b-8ff3-1c4ed681d97e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:38.369861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 926/1867] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:38.374783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57476-379a-45ce-ab51-374998e3e9c5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:38.387118 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57476-379a-45ce-ab51-374998e3e9c5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:38.392086 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b128213-8f4c-4d3b-8d1f-7b6f7ee3284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:38.393304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b128213-8f4c-4d3b-8d1f-7b6f7ee3284f admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.393540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b128213-8f4c-4d3b-8d1f-7b6f7ee3284f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.393822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b128213-8f4c-4d3b-8d1f-7b6f7ee3284f admin admin] PATH_INFO: `/v3/projects/f5fe2b3fd3b0477a831a6a90c42d5bc4/users/8cacf7aedfdc4526b436eae3824371bb/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.399070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b128213-8f4c-4d3b-8d1f-7b6f7ee3284f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fe2b3fd3b0477a831a6a90c42d5bc4, user_id=8cacf7aedfdc4526b436eae3824371bb, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:38.399070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b128213-8f4c-4d3b-8d1f-7b6f7ee3284f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:38.410498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 942/1868] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:38 2022] PUT /identity/v3/projects/f5fe2b3fd3b0477a831a6a90c42d5bc4/users/8cacf7aedfdc4526b436eae3824371bb/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:38.421241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431def-a6ca-4081-992d-29aed5b4d081 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.425272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431def-a6ca-4081-992d-29aed5b4d081 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.425272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431def-a6ca-4081-992d-29aed5b4d081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.452970 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7b431def-a6ca-4081-992d-29aed5b4d081 None None] MFA Rules not processed for user `8cacf7aedfdc4526b436eae3824371bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:38.454362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7b431def-a6ca-4081-992d-29aed5b4d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:38.524597 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 927/1869] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:38.536083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b128213-8f4c-4d3b-8d1f-7b6f7ee3284f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:38.538446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8b128213-8f4c-4d3b-8d1f-7b6f7ee3284f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:38.611830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b128213-8f4c-4d3b-8d1f-7b6f7ee3284f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:38.615749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffa5e9-874e-4114-81f1-6b002d3d0aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:38.616484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffa5e9-874e-4114-81f1-6b002d3d0aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.616841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffa5e9-874e-4114-81f1-6b002d3d0aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.617207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffa5e9-874e-4114-81f1-6b002d3d0aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.630856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffa5e9-874e-4114-81f1-6b002d3d0aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:38.632383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffa5e9-874e-4114-81f1-6b002d3d0aa3 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:38.643562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 943/1870] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:38.767494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dfa70-d891-40e9-a085-8b0cc46bcf58 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.767835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dfa70-d891-40e9-a085-8b0cc46bcf58 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.768137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dfa70-d891-40e9-a085-8b0cc46bcf58 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.769516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 928/1871] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:38.776518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8289-eda0-4b4f-bb80-15ede623c345 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.776801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8289-eda0-4b4f-bb80-15ede623c345 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.777076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8289-eda0-4b4f-bb80-15ede623c345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.800165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-973d8289-eda0-4b4f-bb80-15ede623c345 None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:38.801513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-973d8289-eda0-4b4f-bb80-15ede623c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:38.873556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 944/1872] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:38.886060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dfa70-d891-40e9-a085-8b0cc46bcf58 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:38.887827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-416dfa70-d891-40e9-a085-8b0cc46bcf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:38.911758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dfa70-d891-40e9-a085-8b0cc46bcf58 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:38.913360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaac77-2c93-4303-a638-e4b014617925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:38.913877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaac77-2c93-4303-a638-e4b014617925 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.914156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaac77-2c93-4303-a638-e4b014617925 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.914430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaac77-2c93-4303-a638-e4b014617925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.924961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaac77-2c93-4303-a638-e4b014617925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:38.926567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaac77-2c93-4303-a638-e4b014617925 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:38.938658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 929/1873] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:39.204068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:39.410473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:40.173562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8289-eda0-4b4f-bb80-15ede623c345 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:40.264048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8289-eda0-4b4f-bb80-15ede623c345 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:40.268702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:40.269776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:40.270444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:40.270444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] PATH_INFO: `/v3/users/7d248b71668f4a588671d39cd8898187` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:40.271455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d248b71668f4a588671d39cd8898187)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:40.273344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:40.558782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d248b71668f4a588671d39cd8898187'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.559717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d248b71668f4a588671d39cd8898187'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.560340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d248b71668f4a588671d39cd8898187'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.588974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d248b71668f4a588671d39cd8898187'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.599080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d248b71668f4a588671d39cd8898187'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.655836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:40.718095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 945/1874] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:40 2022] DELETE /identity/v3/users/7d248b71668f4a588671d39cd8898187 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:40.726457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f801bab-8390-486e-8977-4a4dc0340f0d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:40.726741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f801bab-8390-486e-8977-4a4dc0340f0d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:40.727012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f801bab-8390-486e-8977-4a4dc0340f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:40.745336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7f801bab-8390-486e-8977-4a4dc0340f0d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:40.747270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7f801bab-8390-486e-8977-4a4dc0340f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:40.813890 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 930/1875] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:40.820449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:40.822221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:40.885934 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504fd49-734d-4f26-a52a-68595d1cec39 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:40.890032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b5763-37c6-4398-8193-739ecec35138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:40.890785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b5763-37c6-4398-8193-739ecec35138 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:40.891073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b5763-37c6-4398-8193-739ecec35138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:40.891382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b5763-37c6-4398-8193-739ecec35138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:40.901491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b5763-37c6-4398-8193-739ecec35138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:40.903123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b5763-37c6-4398-8193-739ecec35138 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:40.912991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 946/1876] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:41.001035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:41.382096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f801bab-8390-486e-8977-4a4dc0340f0d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:41.383724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7f801bab-8390-486e-8977-4a4dc0340f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:41.395792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f801bab-8390-486e-8977-4a4dc0340f0d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:41.400462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:41.402378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.402378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.402378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] PATH_INFO: `/v3/projects/b58e431dcc0f43309fe7a8f2e75dd155` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:41.403629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58e431dcc0f43309fe7a8f2e75dd155)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:41.405532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:41.566229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58e431dcc0f43309fe7a8f2e75dd155', 'request_id': 'req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.572841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58e431dcc0f43309fe7a8f2e75dd155', 'request_id': 'req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.652293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58e431dcc0f43309fe7a8f2e75dd155', 'request_id': 'req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.665448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] The token cache is being invalidate because project b58e431dcc0f43309fe7a8f2e75dd155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:41.666001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.666785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.673614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 931/1877] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:41 2022] DELETE /identity/v3/projects/b58e431dcc0f43309fe7a8f2e75dd155 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:41.674833 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b5763-37c6-4398-8193-739ecec35138 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:41.675300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:41.677333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:41.677963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-063b5763-37c6-4398-8193-739ecec35138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:41.709147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b5763-37c6-4398-8193-739ecec35138 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:41.840618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d91e5b-ea1b-4ef9-afd7-b14449a62d8a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:41.866977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:41.878527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.878527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.878527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] PATH_INFO: `/v3/users/8cacf7aedfdc4526b436eae3824371bb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:41.878972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:41.879723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.880040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.880309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] PATH_INFO: `/v3/users/977ec278107141fd93f8ff749b6cc045` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:41.881900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977ec278107141fd93f8ff749b6cc045)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:41.882766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cacf7aedfdc4526b436eae3824371bb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:41.884429 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:41.886932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.082144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:42.169248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977ec278107141fd93f8ff749b6cc045'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.170189 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977ec278107141fd93f8ff749b6cc045'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.176927 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977ec278107141fd93f8ff749b6cc045'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.209417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cacf7aedfdc4526b436eae3824371bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.210125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cacf7aedfdc4526b436eae3824371bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.216841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977ec278107141fd93f8ff749b6cc045'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.238675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cacf7aedfdc4526b436eae3824371bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.241787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f2d77006-7f4b-48ed-b628-69158bab9404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977ec278107141fd93f8ff749b6cc045'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.254670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cacf7aedfdc4526b436eae3824371bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.261427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cacf7aedfdc4526b436eae3824371bb'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:42.396816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:42.415298 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 947/1878] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:41 2022] DELETE /identity/v3/users/977ec278107141fd93f8ff749b6cc045 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:42.421538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed8316-048f-4398-acdf-3aa66344081d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.421817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed8316-048f-4398-acdf-3aa66344081d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.422095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed8316-048f-4398-acdf-3aa66344081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.446377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a7ed8316-048f-4398-acdf-3aa66344081d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:42.448127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a7ed8316-048f-4398-acdf-3aa66344081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:42.517357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 948/1879] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:42.528248 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 932/1880] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:41 2022] DELETE /identity/v3/users/8cacf7aedfdc4526b436eae3824371bb => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:42.536764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed8316-048f-4398-acdf-3aa66344081d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.538370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a7ed8316-048f-4398-acdf-3aa66344081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:42.646535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed8316-048f-4398-acdf-3aa66344081d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.716161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a5d25-f127-4b68-8206-335ad9ac0432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.716823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a5d25-f127-4b68-8206-335ad9ac0432 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.717108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a5d25-f127-4b68-8206-335ad9ac0432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.717383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a5d25-f127-4b68-8206-335ad9ac0432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.785052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a5d25-f127-4b68-8206-335ad9ac0432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.786653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a5d25-f127-4b68-8206-335ad9ac0432 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.797569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 949/1881] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:43.043715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.045219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.058803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737298f-926f-4ed3-9b22-e2eb956daced admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.073792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.079357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.080050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.080501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] PATH_INFO: `/v3/projects/f5fe2b3fd3b0477a831a6a90c42d5bc4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.082674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fe2b3fd3b0477a831a6a90c42d5bc4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.085082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.249306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fe2b3fd3b0477a831a6a90c42d5bc4', 'request_id': 'req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.255563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fe2b3fd3b0477a831a6a90c42d5bc4', 'request_id': 'req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.335937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a5d25-f127-4b68-8206-335ad9ac0432 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.337682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9a8a5d25-f127-4b68-8206-335ad9ac0432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.359290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a5d25-f127-4b68-8206-335ad9ac0432 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.408145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fe2b3fd3b0477a831a6a90c42d5bc4', 'request_id': 'req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.423868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.424743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.425022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.425295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] PATH_INFO: `/v3/projects/65a1d744979046419c260654552eb878` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.426504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a1d744979046419c260654552eb878)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.426918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] The token cache is being invalidate because project f5fe2b3fd3b0477a831a6a90c42d5bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:43.428697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.429834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.430826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3da3c8b3-b1c8-49e3-9c08-f07c2fa1af7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.446369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 933/1882] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:43 2022] DELETE /identity/v3/projects/f5fe2b3fd3b0477a831a6a90c42d5bc4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:43.448554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b07baa-1542-4624-9e6d-7a8783ca6d9f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.448843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b07baa-1542-4624-9e6d-7a8783ca6d9f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.451010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b07baa-1542-4624-9e6d-7a8783ca6d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.476058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-17b07baa-1542-4624-9e6d-7a8783ca6d9f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:43.477374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-17b07baa-1542-4624-9e6d-7a8783ca6d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.486815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 934/1883] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:43.497337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d9e36-d21c-4057-80fc-8a9589d02bf0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.497634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d9e36-d21c-4057-80fc-8a9589d02bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.497915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d9e36-d21c-4057-80fc-8a9589d02bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.528272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-878d9e36-d21c-4057-80fc-8a9589d02bf0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:43.530991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-878d9e36-d21c-4057-80fc-8a9589d02bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.533546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:43.554372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 935/1884] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:43.555342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d9e36-d21c-4057-80fc-8a9589d02bf0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.570282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d9e36-d21c-4057-80fc-8a9589d02bf0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.578801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2fad8-f4b9-4af4-936f-8e019d3aa0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.579537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2fad8-f4b9-4af4-936f-8e019d3aa0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.580097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2fad8-f4b9-4af4-936f-8e019d3aa0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.580524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2fad8-f4b9-4af4-936f-8e019d3aa0f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.581689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2fad8-f4b9-4af4-936f-8e019d3aa0f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:43.582155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2fad8-f4b9-4af4-936f-8e019d3aa0f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.584520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2fad8-f4b9-4af4-936f-8e019d3aa0f7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.604566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 936/1885] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:43.607198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2fad8-f4b9-4af4-936f-8e019d3aa0f7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.615845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a1d744979046419c260654552eb878', 'request_id': 'req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.617756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2fad8-f4b9-4af4-936f-8e019d3aa0f7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.623702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a1d744979046419c260654552eb878', 'request_id': 'req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.685191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e37b93-7931-4866-acbb-eb4c5e583f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.685867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e37b93-7931-4866-acbb-eb4c5e583f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.686150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e37b93-7931-4866-acbb-eb4c5e583f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.686427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e37b93-7931-4866-acbb-eb4c5e583f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.687147 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e37b93-7931-4866-acbb-eb4c5e583f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.689050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e37b93-7931-4866-acbb-eb4c5e583f30 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.723222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a1d744979046419c260654552eb878', 'request_id': 'req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.736711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] The token cache is being invalidate because project 65a1d744979046419c260654552eb878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:43.736711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.737308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.738857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 950/1886] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:43 2022] DELETE /identity/v3/projects/65a1d744979046419c260654552eb878 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:43.742978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.744952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.759108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c374ea0-a383-4dd0-954c-69f9ef4cb2c8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.763716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.764602 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.764882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.765169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] PATH_INFO: `/v3/users/36ad757be2914834abd93ab1013f7431` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.766361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ad757be2914834abd93ab1013f7431)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.768285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.781852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 937/1887] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:43 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:43.786029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e37b93-7931-4866-acbb-eb4c5e583f30 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.787724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-63e37b93-7931-4866-acbb-eb4c5e583f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.851472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e37b93-7931-4866-acbb-eb4c5e583f30 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.856760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e9333-f393-4d5e-b1e0-4c38004891bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.857431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e9333-f393-4d5e-b1e0-4c38004891bb admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.857714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e9333-f393-4d5e-b1e0-4c38004891bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.857991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e9333-f393-4d5e-b1e0-4c38004891bb admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.858674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e9333-f393-4d5e-b1e0-4c38004891bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.860614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e9333-f393-4d5e-b1e0-4c38004891bb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.906374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:43.977999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 938/1888] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:43 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:43.979413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e9333-f393-4d5e-b1e0-4c38004891bb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.980966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b10e9333-f393-4d5e-b1e0-4c38004891bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.989708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ad757be2914834abd93ab1013f7431'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.990352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ad757be2914834abd93ab1013f7431'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.990959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ad757be2914834abd93ab1013f7431'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.993229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e9333-f393-4d5e-b1e0-4c38004891bb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.998739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.999667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.999953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.000230 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] PATH_INFO: `/v3/users/31284ff9f34646efa361ea32a6c9e5ed` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.001422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31284ff9f34646efa361ea32a6c9e5ed)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.003349 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.003754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ad757be2914834abd93ab1013f7431'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.011011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ad757be2914834abd93ab1013f7431'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.103151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 951/1889] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:43 2022] DELETE /identity/v3/users/36ad757be2914834abd93ab1013f7431 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:44.104577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.105892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.173004 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af29c7-661d-4be5-a63d-8a8bc2819f05 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.177780 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9bcca-3e6c-48fd-bbf3-e4eae0e75e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.178448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9bcca-3e6c-48fd-bbf3-e4eae0e75e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.178730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9bcca-3e6c-48fd-bbf3-e4eae0e75e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.179181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9bcca-3e6c-48fd-bbf3-e4eae0e75e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.179760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9bcca-3e6c-48fd-bbf3-e4eae0e75e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.182337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9bcca-3e6c-48fd-bbf3-e4eae0e75e26 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.195629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 952/1890] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:44.196677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9bcca-3e6c-48fd-bbf3-e4eae0e75e26 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.207736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9bcca-3e6c-48fd-bbf3-e4eae0e75e26 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.212473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d399-d3c2-40d3-b470-65bd2dea06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.213661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d399-d3c2-40d3-b470-65bd2dea06e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.213941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d399-d3c2-40d3-b470-65bd2dea06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.216092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d399-d3c2-40d3-b470-65bd2dea06e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.216092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595d399-d3c2-40d3-b470-65bd2dea06e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.216537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595d399-d3c2-40d3-b470-65bd2dea06e3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.226796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 953/1891] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:44.231284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d399-d3c2-40d3-b470-65bd2dea06e3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.242174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d399-d3c2-40d3-b470-65bd2dea06e3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.250637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a8bd8-76eb-4999-b159-591ed2878d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.250637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a8bd8-76eb-4999-b159-591ed2878d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.250637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a8bd8-76eb-4999-b159-591ed2878d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.250637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a8bd8-76eb-4999-b159-591ed2878d6a admin admin] PATH_INFO: `/v3/projects/990dbdf8d39a43ff9e36b097856d29b5/users/00268ba425b04d078e2ea6f9ccfbdfe3/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.260271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31284ff9f34646efa361ea32a6c9e5ed'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.262122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31284ff9f34646efa361ea32a6c9e5ed'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.264469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a8bd8-76eb-4999-b159-591ed2878d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=990dbdf8d39a43ff9e36b097856d29b5, user_id=00268ba425b04d078e2ea6f9ccfbdfe3, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.267136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a8bd8-76eb-4999-b159-591ed2878d6a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.279051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31284ff9f34646efa361ea32a6c9e5ed'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.286037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31284ff9f34646efa361ea32a6c9e5ed'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.286752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88a19c9d-f80c-46f1-b30c-d4bcb656a024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31284ff9f34646efa361ea32a6c9e5ed'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.382344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 954/1892] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:44 2022] PUT /identity/v3/projects/990dbdf8d39a43ff9e36b097856d29b5/users/00268ba425b04d078e2ea6f9ccfbdfe3/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:44.392060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa792-cdc4-409f-b481-a1f8dd8eae17 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.392353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa792-cdc4-409f-b481-a1f8dd8eae17 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.392623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa792-cdc4-409f-b481-a1f8dd8eae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.427993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5baaa792-cdc4-409f-b481-a1f8dd8eae17 None None] MFA Rules not processed for user `00268ba425b04d078e2ea6f9ccfbdfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:44.429600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5baaa792-cdc4-409f-b481-a1f8dd8eae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.493626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 939/1893] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:43 2022] DELETE /identity/v3/users/31284ff9f34646efa361ea32a6c9e5ed => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:44.498188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b17e1-e8de-4b14-aa13-055c721e55b1 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.498721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b17e1-e8de-4b14-aa13-055c721e55b1 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.499256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b17e1-e8de-4b14-aa13-055c721e55b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.522180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 955/1894] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:44.524165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4c9b17e1-e8de-4b14-aa13-055c721e55b1 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:44.526172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4c9b17e1-e8de-4b14-aa13-055c721e55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.527057 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa792-cdc4-409f-b481-a1f8dd8eae17 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.528379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5baaa792-cdc4-409f-b481-a1f8dd8eae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.599476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 940/1895] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:44.605746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b17e1-e8de-4b14-aa13-055c721e55b1 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.607531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4c9b17e1-e8de-4b14-aa13-055c721e55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.616951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa792-cdc4-409f-b481-a1f8dd8eae17 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.624393 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2716a4-5649-465d-9a14-95f47846507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.625063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2716a4-5649-465d-9a14-95f47846507b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.625343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2716a4-5649-465d-9a14-95f47846507b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.625614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2716a4-5649-465d-9a14-95f47846507b admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.626401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2716a4-5649-465d-9a14-95f47846507b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.628361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2716a4-5649-465d-9a14-95f47846507b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.738354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b17e1-e8de-4b14-aa13-055c721e55b1 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.752936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28b2c1-0e63-48f7-9ed5-4c0453635618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.753601 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28b2c1-0e63-48f7-9ed5-4c0453635618 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.756331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28b2c1-0e63-48f7-9ed5-4c0453635618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.756331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28b2c1-0e63-48f7-9ed5-4c0453635618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.771599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28b2c1-0e63-48f7-9ed5-4c0453635618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.772983 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28b2c1-0e63-48f7-9ed5-4c0453635618 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.785844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 941/1896] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:44.786779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28b2c1-0e63-48f7-9ed5-4c0453635618 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.788921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3b28b2c1-0e63-48f7-9ed5-4c0453635618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.803941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28b2c1-0e63-48f7-9ed5-4c0453635618 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.810539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.811649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.811937 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.812217 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] PATH_INFO: `/v3/projects/3022bdea88124811961a2a024fb1bece` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.813535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3022bdea88124811961a2a024fb1bece)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.816774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.816887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 956/1897] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:44 2022] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:44.817711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2716a4-5649-465d-9a14-95f47846507b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.958523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2716a4-5649-465d-9a14-95f47846507b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.964380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbea46-1354-4b8c-9e08-c78e0809d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.965159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbea46-1354-4b8c-9e08-c78e0809d146 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.965443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbea46-1354-4b8c-9e08-c78e0809d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.965881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbea46-1354-4b8c-9e08-c78e0809d146 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.966537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbea46-1354-4b8c-9e08-c78e0809d146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.968772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbea46-1354-4b8c-9e08-c78e0809d146 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.024412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:45.048835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3022bdea88124811961a2a024fb1bece', 'request_id': 'req-decff8d5-dbd6-42e9-9f16-1dd709506e86'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.056051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3022bdea88124811961a2a024fb1bece', 'request_id': 'req-decff8d5-dbd6-42e9-9f16-1dd709506e86'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.086169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 957/1898] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:44 2022] POST /identity/v3/users => generated 296 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:45.090043 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbea46-1354-4b8c-9e08-c78e0809d146 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.099600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbea46-1354-4b8c-9e08-c78e0809d146 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.183249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3022bdea88124811961a2a024fb1bece', 'request_id': 'req-decff8d5-dbd6-42e9-9f16-1dd709506e86'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.199386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] The token cache is being invalidate because project 3022bdea88124811961a2a024fb1bece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:45.199708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.200383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-decff8d5-dbd6-42e9-9f16-1dd709506e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.202051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 942/1899] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:44 2022] DELETE /identity/v3/projects/3022bdea88124811961a2a024fb1bece => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:45.207115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aed07-5a5f-4a08-9aa1-48334ab82106 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.207559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aed07-5a5f-4a08-9aa1-48334ab82106 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.207875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aed07-5a5f-4a08-9aa1-48334ab82106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.226214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d35f0-407b-4f30-9aee-d821cf6908f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.229129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d35f0-407b-4f30-9aee-d821cf6908f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.229129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d35f0-407b-4f30-9aee-d821cf6908f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.229129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d35f0-407b-4f30-9aee-d821cf6908f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.229129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d35f0-407b-4f30-9aee-d821cf6908f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.230760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d35f0-407b-4f30-9aee-d821cf6908f5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.239408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-564aed07-5a5f-4a08-9aa1-48334ab82106 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:45.240207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-564aed07-5a5f-4a08-9aa1-48334ab82106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.252317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 958/1900] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:45.253771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d35f0-407b-4f30-9aee-d821cf6908f5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.275516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 943/1901] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:45.278359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-275d35f0-407b-4f30-9aee-d821cf6908f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.289208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca0d75-c9d0-47e1-b1e6-baf2e85cc8f0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.289402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca0d75-c9d0-47e1-b1e6-baf2e85cc8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.289661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca0d75-c9d0-47e1-b1e6-baf2e85cc8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.296895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d35f0-407b-4f30-9aee-d821cf6908f5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.303514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba714896-d32f-415c-ba87-0c7b358cd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.304942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba714896-d32f-415c-ba87-0c7b358cd302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.305404 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba714896-d32f-415c-ba87-0c7b358cd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.305781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba714896-d32f-415c-ba87-0c7b358cd302 admin admin] PATH_INFO: `/v3/projects/874b92c48f1a4994a1ad20708898fc0c/users/51b4a113b0f443e29701474f93899b85/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.311698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a9ca0d75-c9d0-47e1-b1e6-baf2e85cc8f0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:45.313205 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a9ca0d75-c9d0-47e1-b1e6-baf2e85cc8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.322168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 944/1902] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:45.326835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba714896-d32f-415c-ba87-0c7b358cd302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874b92c48f1a4994a1ad20708898fc0c, user_id=51b4a113b0f443e29701474f93899b85, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.327130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca0d75-c9d0-47e1-b1e6-baf2e85cc8f0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.330482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba714896-d32f-415c-ba87-0c7b358cd302 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.338973 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca0d75-c9d0-47e1-b1e6-baf2e85cc8f0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.344692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d174ab-a4c0-405d-9211-7790fa222a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.345410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d174ab-a4c0-405d-9211-7790fa222a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.346402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d174ab-a4c0-405d-9211-7790fa222a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.346402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d174ab-a4c0-405d-9211-7790fa222a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.346704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d174ab-a4c0-405d-9211-7790fa222a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:45.346967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d174ab-a4c0-405d-9211-7790fa222a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.348933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d174ab-a4c0-405d-9211-7790fa222a6c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.369757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 945/1903] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:45.369757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d174ab-a4c0-405d-9211-7790fa222a6c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.379978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d174ab-a4c0-405d-9211-7790fa222a6c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.384800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c4cdd-61e4-4cad-8226-44233ab40d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.385448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c4cdd-61e4-4cad-8226-44233ab40d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.385736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c4cdd-61e4-4cad-8226-44233ab40d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.386017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c4cdd-61e4-4cad-8226-44233ab40d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.386704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c4cdd-61e4-4cad-8226-44233ab40d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.388836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c4cdd-61e4-4cad-8226-44233ab40d72 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.469430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 959/1904] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:45 2022] PUT /identity/v3/projects/874b92c48f1a4994a1ad20708898fc0c/users/51b4a113b0f443e29701474f93899b85/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:45.473222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba714896-d32f-415c-ba87-0c7b358cd302 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.531771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 946/1905] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:45.533039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c4cdd-61e4-4cad-8226-44233ab40d72 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.535774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1a4c4cdd-61e4-4cad-8226-44233ab40d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.551343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba714896-d32f-415c-ba87-0c7b358cd302 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.572938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:45.627268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8d004-831d-4d67-ad7d-d84421c39e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.627268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8d004-831d-4d67-ad7d-d84421c39e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.627268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8d004-831d-4d67-ad7d-d84421c39e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.627268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8d004-831d-4d67-ad7d-d84421c39e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.627669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8d004-831d-4d67-ad7d-d84421c39e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.629025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8d004-831d-4d67-ad7d-d84421c39e37 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.632589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c4cdd-61e4-4cad-8226-44233ab40d72 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.638225 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.639227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.639512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.639784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] PATH_INFO: `/v3/projects/19dad23c727140f98053c4689b4b08c4` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.641136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=19dad23c727140f98053c4689b4b08c4)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.641708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 960/1906] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:45.643757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.645557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8d004-831d-4d67-ad7d-d84421c39e37 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.656135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8d004-831d-4d67-ad7d-d84421c39e37 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.661146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b796f-7c34-4ae8-878f-1adbbf1a5100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.661826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b796f-7c34-4ae8-878f-1adbbf1a5100 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.662109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b796f-7c34-4ae8-878f-1adbbf1a5100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.662387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b796f-7c34-4ae8-878f-1adbbf1a5100 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.665089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b796f-7c34-4ae8-878f-1adbbf1a5100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.665199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b796f-7c34-4ae8-878f-1adbbf1a5100 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.749691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 961/1907] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:45.750495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b796f-7c34-4ae8-878f-1adbbf1a5100 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.760580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b796f-7c34-4ae8-878f-1adbbf1a5100 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.761332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19dad23c727140f98053c4689b4b08c4', 'request_id': 'req-7553ad4b-04d0-454e-b4f1-87410ce7f06c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.768129 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19dad23c727140f98053c4689b4b08c4', 'request_id': 'req-7553ad4b-04d0-454e-b4f1-87410ce7f06c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.815978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108fb0-8ffb-49ab-a58b-8678cc7564ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.816870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108fb0-8ffb-49ab-a58b-8678cc7564ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.817155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108fb0-8ffb-49ab-a58b-8678cc7564ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.817700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108fb0-8ffb-49ab-a58b-8678cc7564ee admin admin] PATH_INFO: `/v3/projects/874b92c48f1a4994a1ad20708898fc0c/users/51b4a113b0f443e29701474f93899b85/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.819520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86108fb0-8ffb-49ab-a58b-8678cc7564ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=874b92c48f1a4994a1ad20708898fc0c, user_id=51b4a113b0f443e29701474f93899b85, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.822124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86108fb0-8ffb-49ab-a58b-8678cc7564ee admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.833478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 962/1908] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:45 2022] PUT /identity/v3/projects/874b92c48f1a4994a1ad20708898fc0c/users/51b4a113b0f443e29701474f93899b85/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:45.834424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108fb0-8ffb-49ab-a58b-8678cc7564ee admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.856644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19dad23c727140f98053c4689b4b08c4', 'request_id': 'req-7553ad4b-04d0-454e-b4f1-87410ce7f06c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.868457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] The token cache is being invalidate because project 19dad23c727140f98053c4689b4b08c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:45.868860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.869584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7553ad4b-04d0-454e-b4f1-87410ce7f06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.871605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 947/1909] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:45 2022] DELETE /identity/v3/projects/19dad23c727140f98053c4689b4b08c4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:45.873006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d542d-47f0-40ce-86e4-565f4c812fdf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.873379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d542d-47f0-40ce-86e4-565f4c812fdf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.873725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d542d-47f0-40ce-86e4-565f4c812fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.900134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-584d542d-47f0-40ce-86e4-565f4c812fdf None None] MFA Rules not processed for user `51b4a113b0f443e29701474f93899b85`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:45.901803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-584d542d-47f0-40ce-86e4-565f4c812fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.902097 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86108fb0-8ffb-49ab-a58b-8678cc7564ee admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.906878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a30a-5059-4f22-8433-4f70a0955a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.907570 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a30a-5059-4f22-8433-4f70a0955a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.907854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a30a-5059-4f22-8433-4f70a0955a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.908127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a30a-5059-4f22-8433-4f70a0955a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.908845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105a30a-5059-4f22-8433-4f70a0955a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.910457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105a30a-5059-4f22-8433-4f70a0955a2e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.921262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 963/1910] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:45.922246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a30a-5059-4f22-8433-4f70a0955a2e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.924147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9105a30a-5059-4f22-8433-4f70a0955a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.936675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a30a-5059-4f22-8433-4f70a0955a2e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.942851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.943771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.944053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.944320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] PATH_INFO: `/v3/users/68d78a99d19445da83dae553bc9fe69d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.946070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d78a99d19445da83dae553bc9fe69d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.948322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.980810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 948/1911] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:45.985124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d542d-47f0-40ce-86e4-565f4c812fdf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.986475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-584d542d-47f0-40ce-86e4-565f4c812fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.002123 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d542d-47f0-40ce-86e4-565f4c812fdf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.008821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231671-eb6d-4195-9321-9bd9200f4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.010260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231671-eb6d-4195-9321-9bd9200f4b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.010637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231671-eb6d-4195-9321-9bd9200f4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.011121 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231671-eb6d-4195-9321-9bd9200f4b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.011921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85231671-eb6d-4195-9321-9bd9200f4b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.013665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85231671-eb6d-4195-9321-9bd9200f4b13 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.029950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 949/1912] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:46.029950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231671-eb6d-4195-9321-9bd9200f4b13 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.031296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-85231671-eb6d-4195-9321-9bd9200f4b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.115137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231671-eb6d-4195-9321-9bd9200f4b13 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.119818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061efd-e5c1-4e13-8797-3bef1d8753af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.120859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061efd-e5c1-4e13-8797-3bef1d8753af service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.121205 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061efd-e5c1-4e13-8797-3bef1d8753af service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.121541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061efd-e5c1-4e13-8797-3bef1d8753af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.132166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e061efd-e5c1-4e13-8797-3bef1d8753af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.134082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e061efd-e5c1-4e13-8797-3bef1d8753af service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.147125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d78a99d19445da83dae553bc9fe69d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.147968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d78a99d19445da83dae553bc9fe69d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.148599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 950/1913] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:46.148948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d78a99d19445da83dae553bc9fe69d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.149578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061efd-e5c1-4e13-8797-3bef1d8753af service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.164783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d78a99d19445da83dae553bc9fe69d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.167895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061efd-e5c1-4e13-8797-3bef1d8753af service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.173382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-49450690-0a69-498f-bd9a-a0ea6286780c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d78a99d19445da83dae553bc9fe69d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.174490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff05888-34f4-4db6-a815-569b988f80f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.175372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05888-34f4-4db6-a815-569b988f80f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.175656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05888-34f4-4db6-a815-569b988f80f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.175966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05888-34f4-4db6-a815-569b988f80f0 admin admin] PATH_INFO: `/v3/projects/52b36cbab99143a086a96aca91a9f5f1/users/84bd0b7836cb45f1a97cd36e739dd719/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.193059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff05888-34f4-4db6-a815-569b988f80f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b36cbab99143a086a96aca91a9f5f1, user_id=84bd0b7836cb45f1a97cd36e739dd719, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.195743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff05888-34f4-4db6-a815-569b988f80f0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.309078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 964/1914] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:45 2022] DELETE /identity/v3/users/68d78a99d19445da83dae553bc9fe69d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:46.310221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 951/1915] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:46 2022] PUT /identity/v3/projects/52b36cbab99143a086a96aca91a9f5f1/users/84bd0b7836cb45f1a97cd36e739dd719/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:46.320333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050f695-9b7e-4823-99a9-35f0c0694bae None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.320696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050f695-9b7e-4823-99a9-35f0c0694bae None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.320878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050f695-9b7e-4823-99a9-35f0c0694bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.362216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7050f695-9b7e-4823-99a9-35f0c0694bae None None] MFA Rules not processed for user `84bd0b7836cb45f1a97cd36e739dd719`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:46.363572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7050f695-9b7e-4823-99a9-35f0c0694bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.448973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 965/1916] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:46.454095 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff05888-34f4-4db6-a815-569b988f80f0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.455990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0ff05888-34f4-4db6-a815-569b988f80f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.526221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:46.554478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff05888-34f4-4db6-a815-569b988f80f0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.649909 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6ca5-2520-4c91-9b51-3067c2bb67dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.650614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6ca5-2520-4c91-9b51-3067c2bb67dd admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.650897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6ca5-2520-4c91-9b51-3067c2bb67dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.651199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6ca5-2520-4c91-9b51-3067c2bb67dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.651903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b6ca5-2520-4c91-9b51-3067c2bb67dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.654060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b6ca5-2520-4c91-9b51-3067c2bb67dd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.762952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 952/1917] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:46.764591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050f695-9b7e-4823-99a9-35f0c0694bae None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.775725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050f695-9b7e-4823-99a9-35f0c0694bae None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.840011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb5cc3-29db-4bde-b3e0-8cb113e8163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.840011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb5cc3-29db-4bde-b3e0-8cb113e8163a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.840011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb5cc3-29db-4bde-b3e0-8cb113e8163a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.840011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb5cc3-29db-4bde-b3e0-8cb113e8163a admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.840819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb5cc3-29db-4bde-b3e0-8cb113e8163a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.841701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb5cc3-29db-4bde-b3e0-8cb113e8163a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.843285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6ca5-2520-4c91-9b51-3067c2bb67dd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.845030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c9b6ca5-2520-4c91-9b51-3067c2bb67dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.877096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6ca5-2520-4c91-9b51-3067c2bb67dd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.900721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.900721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.900721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.900721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] PATH_INFO: `/v3/projects/611e2e960bcc447e9a219ee909bcd038` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.901050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611e2e960bcc447e9a219ee909bcd038)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.902589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.969199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 966/1918] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:46.969199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb5cc3-29db-4bde-b3e0-8cb113e8163a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.971688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-79eb5cc3-29db-4bde-b3e0-8cb113e8163a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.984442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb5cc3-29db-4bde-b3e0-8cb113e8163a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.989841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.990714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.990993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.991289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] PATH_INFO: `/v3/users/00268ba425b04d078e2ea6f9ccfbdfe3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.994859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00268ba425b04d078e2ea6f9ccfbdfe3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.995062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.030455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611e2e960bcc447e9a219ee909bcd038', 'request_id': 'req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.037930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611e2e960bcc447e9a219ee909bcd038', 'request_id': 'req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.146204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611e2e960bcc447e9a219ee909bcd038', 'request_id': 'req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.146364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:47.157793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] The token cache is being invalidate because project 611e2e960bcc447e9a219ee909bcd038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:47.158080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.158721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.160315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 953/1919] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:46 2022] DELETE /identity/v3/projects/611e2e960bcc447e9a219ee909bcd038 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:47.161121 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.162388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.230589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391e9c7-f225-4ff4-8b4f-52396d2b9a67 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.237009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eba7d-9287-47a0-bdc6-e68fd0469a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.237690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eba7d-9287-47a0-bdc6-e68fd0469a29 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.238006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eba7d-9287-47a0-bdc6-e68fd0469a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.238283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eba7d-9287-47a0-bdc6-e68fd0469a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.239059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eba7d-9287-47a0-bdc6-e68fd0469a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.240749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eba7d-9287-47a0-bdc6-e68fd0469a29 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.242117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00268ba425b04d078e2ea6f9ccfbdfe3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.243212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00268ba425b04d078e2ea6f9ccfbdfe3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.243619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00268ba425b04d078e2ea6f9ccfbdfe3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.255908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 954/1920] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:47.255908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9387b4-b931-47db-b0a5-ff5f3df78ebc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.258686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9387b4-b931-47db-b0a5-ff5f3df78ebc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.258686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9387b4-b931-47db-b0a5-ff5f3df78ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.259497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00268ba425b04d078e2ea6f9ccfbdfe3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.270666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00268ba425b04d078e2ea6f9ccfbdfe3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:47.281551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-af9387b4-b931-47db-b0a5-ff5f3df78ebc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:47.282184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-af9387b4-b931-47db-b0a5-ff5f3df78ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.290461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 955/1921] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:47.291950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9387b4-b931-47db-b0a5-ff5f3df78ebc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.298464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-af9387b4-b931-47db-b0a5-ff5f3df78ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.311065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9387b4-b931-47db-b0a5-ff5f3df78ebc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.315977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9156095-59fb-4475-bce8-c8be29db5870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.322102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156095-59fb-4475-bce8-c8be29db5870 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.322102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156095-59fb-4475-bce8-c8be29db5870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.322102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156095-59fb-4475-bce8-c8be29db5870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.322102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9156095-59fb-4475-bce8-c8be29db5870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.322102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9156095-59fb-4475-bce8-c8be29db5870 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.332672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 956/1922] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:47.333819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1fa6f-d364-4a15-8a04-e4cbc3842a5c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.334190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1fa6f-d364-4a15-8a04-e4cbc3842a5c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.334529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1fa6f-d364-4a15-8a04-e4cbc3842a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.354737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6fd1fa6f-d364-4a15-8a04-e4cbc3842a5c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:47.356084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6fd1fa6f-d364-4a15-8a04-e4cbc3842a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.367143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 957/1923] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:47.368194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1fa6f-d364-4a15-8a04-e4cbc3842a5c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.378175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1fa6f-d364-4a15-8a04-e4cbc3842a5c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.382843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56f5be-8aa0-4415-b5a7-0705ce232fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.383746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56f5be-8aa0-4415-b5a7-0705ce232fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.384029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56f5be-8aa0-4415-b5a7-0705ce232fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.384302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56f5be-8aa0-4415-b5a7-0705ce232fe2 admin admin] PATH_INFO: `/v3/projects/b963f567300543acbeace1042f03eb29/users/3f1c34859c5b452e8620e5865fbb3983/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.400103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56f5be-8aa0-4415-b5a7-0705ce232fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b963f567300543acbeace1042f03eb29, user_id=3f1c34859c5b452e8620e5865fbb3983, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.403293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56f5be-8aa0-4415-b5a7-0705ce232fe2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.412149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 967/1924] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:46 2022] DELETE /identity/v3/users/00268ba425b04d078e2ea6f9ccfbdfe3 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:47.413701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.470069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 958/1925] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:47 2022] PUT /identity/v3/projects/b963f567300543acbeace1042f03eb29/users/3f1c34859c5b452e8620e5865fbb3983/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:47.471823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4b76-e8ed-4b74-a549-8100b058debc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.473062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4b76-e8ed-4b74-a549-8100b058debc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.473416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4b76-e8ed-4b74-a549-8100b058debc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.479668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989052e4-4dcf-488f-8d48-fcdabc59d37d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.492006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-217c4b76-e8ed-4b74-a549-8100b058debc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:47.493292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-217c4b76-e8ed-4b74-a549-8100b058debc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.538057 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11ee2a-7ea1-4db5-8450-b7a75fd5dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.538739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ee2a-7ea1-4db5-8450-b7a75fd5dbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.539021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ee2a-7ea1-4db5-8450-b7a75fd5dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.539921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11ee2a-7ea1-4db5-8450-b7a75fd5dbd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.540678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11ee2a-7ea1-4db5-8450-b7a75fd5dbd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:47.541072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11ee2a-7ea1-4db5-8450-b7a75fd5dbd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.542695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11ee2a-7ea1-4db5-8450-b7a75fd5dbd8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.552173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 959/1926] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:47.553475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8924f82-5b7b-4a1b-ae10-5b41efb4e923 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.553754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8924f82-5b7b-4a1b-ae10-5b41efb4e923 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.554026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8924f82-5b7b-4a1b-ae10-5b41efb4e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.558049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 968/1927] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:47.560044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11ee2a-7ea1-4db5-8450-b7a75fd5dbd8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.569744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11ee2a-7ea1-4db5-8450-b7a75fd5dbd8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.575575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664affe1-03ff-43c3-83d0-9e5e9fa49f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.576231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664affe1-03ff-43c3-83d0-9e5e9fa49f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.576515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664affe1-03ff-43c3-83d0-9e5e9fa49f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.576793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664affe1-03ff-43c3-83d0-9e5e9fa49f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.577489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664affe1-03ff-43c3-83d0-9e5e9fa49f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.579425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664affe1-03ff-43c3-83d0-9e5e9fa49f4e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.580547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c8924f82-5b7b-4a1b-ae10-5b41efb4e923 None None] MFA Rules not processed for user `3f1c34859c5b452e8620e5865fbb3983`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:47.581771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c8924f82-5b7b-4a1b-ae10-5b41efb4e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.644769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 960/1928] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:47.645828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8924f82-5b7b-4a1b-ae10-5b41efb4e923 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.647217 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c8924f82-5b7b-4a1b-ae10-5b41efb4e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.659234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 969/1929] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/projects => generated 409 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:47.660099 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664affe1-03ff-43c3-83d0-9e5e9fa49f4e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.706159 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8924f82-5b7b-4a1b-ae10-5b41efb4e923 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.719760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664affe1-03ff-43c3-83d0-9e5e9fa49f4e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.724574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91246eb-b8e4-4f95-a243-d2b52761f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.725162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91246eb-b8e4-4f95-a243-d2b52761f10d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.725444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91246eb-b8e4-4f95-a243-d2b52761f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.725712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91246eb-b8e4-4f95-a243-d2b52761f10d admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.726390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91246eb-b8e4-4f95-a243-d2b52761f10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.728377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91246eb-b8e4-4f95-a243-d2b52761f10d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.754105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baef1ab-3d52-4b98-a636-7b807276178b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.754747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baef1ab-3d52-4b98-a636-7b807276178b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.755023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baef1ab-3d52-4b98-a636-7b807276178b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.755371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baef1ab-3d52-4b98-a636-7b807276178b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.764981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baef1ab-3d52-4b98-a636-7b807276178b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.766383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baef1ab-3d52-4b98-a636-7b807276178b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.776648 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 961/1930] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:47.777401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baef1ab-3d52-4b98-a636-7b807276178b service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.786295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baef1ab-3d52-4b98-a636-7b807276178b service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.791130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a413f1-f8fc-4e60-ac30-81f843f2a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.791791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a413f1-f8fc-4e60-ac30-81f843f2a448 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.792076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a413f1-f8fc-4e60-ac30-81f843f2a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.792355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a413f1-f8fc-4e60-ac30-81f843f2a448 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.795442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a413f1-f8fc-4e60-ac30-81f843f2a448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.795442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a413f1-f8fc-4e60-ac30-81f843f2a448 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.825264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 970/1931] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:47.826544 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91246eb-b8e4-4f95-a243-d2b52761f10d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.887632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91246eb-b8e4-4f95-a243-d2b52761f10d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.892525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd044-e5ba-40e3-b938-f21d7cbcf04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.893173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd044-e5ba-40e3-b938-f21d7cbcf04e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.893453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd044-e5ba-40e3-b938-f21d7cbcf04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.893726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd044-e5ba-40e3-b938-f21d7cbcf04e admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.894409 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfd044-e5ba-40e3-b938-f21d7cbcf04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.896377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfd044-e5ba-40e3-b938-f21d7cbcf04e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.913354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 962/1932] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/users => generated 305 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:47.917523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a413f1-f8fc-4e60-ac30-81f843f2a448 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.928842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a413f1-f8fc-4e60-ac30-81f843f2a448 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.935482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b8c84-0f6d-45ae-9e71-d312e561ed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.936351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b8c84-0f6d-45ae-9e71-d312e561ed09 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.936710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b8c84-0f6d-45ae-9e71-d312e561ed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.937158 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b8c84-0f6d-45ae-9e71-d312e561ed09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.937868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b8c84-0f6d-45ae-9e71-d312e561ed09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.939653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b8c84-0f6d-45ae-9e71-d312e561ed09 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.956470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 963/1933] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:47.957816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b8c84-0f6d-45ae-9e71-d312e561ed09 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.969501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b8c84-0f6d-45ae-9e71-d312e561ed09 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.975478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95758315-9665-443e-ac52-35f9d73cc056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.976648 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95758315-9665-443e-ac52-35f9d73cc056 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.977039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95758315-9665-443e-ac52-35f9d73cc056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.977420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95758315-9665-443e-ac52-35f9d73cc056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.978285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95758315-9665-443e-ac52-35f9d73cc056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.980278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95758315-9665-443e-ac52-35f9d73cc056 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.993680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 964/1934] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:47.998440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95758315-9665-443e-ac52-35f9d73cc056 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.010762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95758315-9665-443e-ac52-35f9d73cc056 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.012269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 971/1935] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:48.018835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0ac35-a0d4-485b-bc4d-035ad59d1db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.019856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0ac35-a0d4-485b-bc4d-035ad59d1db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.020142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0ac35-a0d4-485b-bc4d-035ad59d1db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.020422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0ac35-a0d4-485b-bc4d-035ad59d1db1 admin admin] PATH_INFO: `/v3/projects/47ed112001494598af382a9dd0e27f35/users/4a39ddf72ac0454e8390125a3c59723e/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.020810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd044-e5ba-40e3-b938-f21d7cbcf04e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.038032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd044-e5ba-40e3-b938-f21d7cbcf04e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.039922 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0ac35-a0d4-485b-bc4d-035ad59d1db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ed112001494598af382a9dd0e27f35, user_id=4a39ddf72ac0454e8390125a3c59723e, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.042938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0ac35-a0d4-485b-bc4d-035ad59d1db1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.045212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a149ac-1f9b-45aa-9b7b-1ebfc2da5f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.046571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a149ac-1f9b-45aa-9b7b-1ebfc2da5f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.047263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a149ac-1f9b-45aa-9b7b-1ebfc2da5f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.047637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a149ac-1f9b-45aa-9b7b-1ebfc2da5f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.048537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a149ac-1f9b-45aa-9b7b-1ebfc2da5f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.050441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a149ac-1f9b-45aa-9b7b-1ebfc2da5f85 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.063480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 972/1936] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:48.067854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a149ac-1f9b-45aa-9b7b-1ebfc2da5f85 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.089920 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a149ac-1f9b-45aa-9b7b-1ebfc2da5f85 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.095235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d25da1-0c06-496b-b383-9c98b5d2875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.096182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d25da1-0c06-496b-b383-9c98b5d2875d admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.096465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d25da1-0c06-496b-b383-9c98b5d2875d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.096743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d25da1-0c06-496b-b383-9c98b5d2875d admin admin] PATH_INFO: `/v3/projects/a332d44acd264957ac4ecf5b40932ca7/users/a752d950f7cf488e8f8fa30f246737d1/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.116190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 965/1937] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:47 2022] PUT /identity/v3/projects/47ed112001494598af382a9dd0e27f35/users/4a39ddf72ac0454e8390125a3c59723e/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:48.128512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e259-db06-45e4-a2a0-5b7ac7f31909 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.128806 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e259-db06-45e4-a2a0-5b7ac7f31909 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.129086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e259-db06-45e4-a2a0-5b7ac7f31909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.132186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d25da1-0c06-496b-b383-9c98b5d2875d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a332d44acd264957ac4ecf5b40932ca7, user_id=a752d950f7cf488e8f8fa30f246737d1, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.135795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d25da1-0c06-496b-b383-9c98b5d2875d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.159872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-fb03e259-db06-45e4-a2a0-5b7ac7f31909 None None] MFA Rules not processed for user `4a39ddf72ac0454e8390125a3c59723e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:48.161175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fb03e259-db06-45e4-a2a0-5b7ac7f31909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:48.210706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 973/1938] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:48 2022] PUT /identity/v3/projects/a332d44acd264957ac4ecf5b40932ca7/users/a752d950f7cf488e8f8fa30f246737d1/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:48.215495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d25da1-0c06-496b-b383-9c98b5d2875d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.248377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 966/1939] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:48.249524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e259-db06-45e4-a2a0-5b7ac7f31909 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.250900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fb03e259-db06-45e4-a2a0-5b7ac7f31909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:48.295955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d25da1-0c06-496b-b383-9c98b5d2875d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.300711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea87b44-c50e-4725-b68d-0c96cb1448cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.301469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea87b44-c50e-4725-b68d-0c96cb1448cd admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.301822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea87b44-c50e-4725-b68d-0c96cb1448cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.302159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea87b44-c50e-4725-b68d-0c96cb1448cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.303010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea87b44-c50e-4725-b68d-0c96cb1448cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.304693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea87b44-c50e-4725-b68d-0c96cb1448cd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.316821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 974/1940] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:48.317681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea87b44-c50e-4725-b68d-0c96cb1448cd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.326048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e259-db06-45e4-a2a0-5b7ac7f31909 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.327396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea87b44-c50e-4725-b68d-0c96cb1448cd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.330879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.331783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.332004 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0e462-f0f5-4501-86bc-425fe2082fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.333114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.333114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] PATH_INFO: `/v3/projects/990dbdf8d39a43ff9e36b097856d29b5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.333341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0e462-f0f5-4501-86bc-425fe2082fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.333341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0e462-f0f5-4501-86bc-425fe2082fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.333341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0e462-f0f5-4501-86bc-425fe2082fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.333726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=990dbdf8d39a43ff9e36b097856d29b5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.333860 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0e462-f0f5-4501-86bc-425fe2082fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.335659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.335765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0e462-f0f5-4501-86bc-425fe2082fb6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.377885 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:48.471682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 975/1941] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:48 2022] POST /identity/v3/projects => generated 407 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:48.475683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0e462-f0f5-4501-86bc-425fe2082fb6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.514090 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990dbdf8d39a43ff9e36b097856d29b5', 'request_id': 'req-ccba5810-9ef1-4350-9a44-af2d3f918af9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.528133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990dbdf8d39a43ff9e36b097856d29b5', 'request_id': 'req-ccba5810-9ef1-4350-9a44-af2d3f918af9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.559022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0e462-f0f5-4501-86bc-425fe2082fb6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.606150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990dbdf8d39a43ff9e36b097856d29b5', 'request_id': 'req-ccba5810-9ef1-4350-9a44-af2d3f918af9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.614753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20595f8-37e2-44b0-b0b2-738476700724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.615821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20595f8-37e2-44b0-b0b2-738476700724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.616178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20595f8-37e2-44b0-b0b2-738476700724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.616523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20595f8-37e2-44b0-b0b2-738476700724 admin admin] PATH_INFO: `/v3/projects/a332d44acd264957ac4ecf5b40932ca7/users/a752d950f7cf488e8f8fa30f246737d1/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.617188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] The token cache is being invalidate because project 990dbdf8d39a43ff9e36b097856d29b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:48.617477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.618110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.618646 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20595f8-37e2-44b0-b0b2-738476700724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a332d44acd264957ac4ecf5b40932ca7, user_id=a752d950f7cf488e8f8fa30f246737d1, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.620597 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 967/1942] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:48 2022] DELETE /identity/v3/projects/990dbdf8d39a43ff9e36b097856d29b5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:48.621415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.622198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20595f8-37e2-44b0-b0b2-738476700724 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.623585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:48.633343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 976/1943] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:48 2022] PUT /identity/v3/projects/a332d44acd264957ac4ecf5b40932ca7/users/a752d950f7cf488e8f8fa30f246737d1/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:48.634161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20595f8-37e2-44b0-b0b2-738476700724 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.635787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c20595f8-37e2-44b0-b0b2-738476700724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:48.645593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba5810-9ef1-4350-9a44-af2d3f918af9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.672276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:48.701056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20595f8-37e2-44b0-b0b2-738476700724 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.704127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a8273-a970-4dbc-be9d-dd63fd6c429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.704808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a8273-a970-4dbc-be9d-dd63fd6c429b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.705086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a8273-a970-4dbc-be9d-dd63fd6c429b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.705360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a8273-a970-4dbc-be9d-dd63fd6c429b admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.708397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.708557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a8273-a970-4dbc-be9d-dd63fd6c429b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.708665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.708665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.708665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] PATH_INFO: `/v3/users/51b4a113b0f443e29701474f93899b85` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.708897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a8273-a970-4dbc-be9d-dd63fd6c429b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.708983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b4a113b0f443e29701474f93899b85)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.710449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.775022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 968/1944] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:48 2022] POST /identity/v3/users => generated 310 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:48.775022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff89f6-cc99-49a5-98d0-a83421289d80 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.775022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff89f6-cc99-49a5-98d0-a83421289d80 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.775022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff89f6-cc99-49a5-98d0-a83421289d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.800405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0aff89f6-cc99-49a5-98d0-a83421289d80 None None] MFA Rules not processed for user `a752d950f7cf488e8f8fa30f246737d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:48.801661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0aff89f6-cc99-49a5-98d0-a83421289d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:48.878333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 969/1945] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:48.879623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff89f6-cc99-49a5-98d0-a83421289d80 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.891285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff89f6-cc99-49a5-98d0-a83421289d80 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.898049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f68a6-1a08-4a8c-bcad-46f36263e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.898728 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f68a6-1a08-4a8c-bcad-46f36263e3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.899007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f68a6-1a08-4a8c-bcad-46f36263e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.899729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f68a6-1a08-4a8c-bcad-46f36263e3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.900234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f68a6-1a08-4a8c-bcad-46f36263e3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.902020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f68a6-1a08-4a8c-bcad-46f36263e3c1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.905109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b4a113b0f443e29701474f93899b85'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.905960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b4a113b0f443e29701474f93899b85'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.906578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b4a113b0f443e29701474f93899b85'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.918103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 970/1946] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:48.919514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f68a6-1a08-4a8c-bcad-46f36263e3c1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.921394 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-926f68a6-1a08-4a8c-bcad-46f36263e3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:48.923307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b4a113b0f443e29701474f93899b85'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.930702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b4a113b0f443e29701474f93899b85'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:48.985940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f68a6-1a08-4a8c-bcad-46f36263e3c1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.989854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bff3a-3f3b-48c5-94c1-b9bb6e6e770b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.990512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bff3a-3f3b-48c5-94c1-b9bb6e6e770b service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.990786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bff3a-3f3b-48c5-94c1-b9bb6e6e770b service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.991057 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bff3a-3f3b-48c5-94c1-b9bb6e6e770b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.992834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c41bff3a-3f3b-48c5-94c1-b9bb6e6e770b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:49.005453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bff3a-3f3b-48c5-94c1-b9bb6e6e770b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:49.005902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 977/1947] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:48 2022] DELETE /identity/v3/users/51b4a113b0f443e29701474f93899b85 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:49.006880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bff3a-3f3b-48c5-94c1-b9bb6e6e770b service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:49.006981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:49.008437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:49.024987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 971/1948] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:49.078072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435646-42a9-40f9-9a72-b60563c4f224 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:49.082977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b767-850c-4019-8dae-6a86d737cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:49.084063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b767-850c-4019-8dae-6a86d737cf80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.084346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b767-850c-4019-8dae-6a86d737cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.084618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b767-850c-4019-8dae-6a86d737cf80 admin admin] PATH_INFO: `/v3/projects/20d6b174712e48eda0ec5ff17da1646c/users/ca26677f1c4340fbab8885c5d0a7b919/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.100775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96b767-850c-4019-8dae-6a86d737cf80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d6b174712e48eda0ec5ff17da1646c, user_id=ca26677f1c4340fbab8885c5d0a7b919, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:49.104482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96b767-850c-4019-8dae-6a86d737cf80 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:49.176800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bff3a-3f3b-48c5-94c1-b9bb6e6e770b service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:49.186511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bff3a-3f3b-48c5-94c1-b9bb6e6e770b service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:49.196333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 978/1949] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:49 2022] PUT /identity/v3/projects/20d6b174712e48eda0ec5ff17da1646c/users/ca26677f1c4340fbab8885c5d0a7b919/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:49.200619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b767-850c-4019-8dae-6a86d737cf80 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:49.279975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c20eb-57ca-48f2-a4a1-63920255f8c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:49.280845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c20eb-57ca-48f2-a4a1-63920255f8c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.281186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c20eb-57ca-48f2-a4a1-63920255f8c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.281495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c20eb-57ca-48f2-a4a1-63920255f8c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.284711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-464c20eb-57ca-48f2-a4a1-63920255f8c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:49.304575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b767-850c-4019-8dae-6a86d737cf80 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:49.312782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac230ef-81b4-459b-a1f2-a0c5fdd49654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:49.313877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac230ef-81b4-459b-a1f2-a0c5fdd49654 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.314304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac230ef-81b4-459b-a1f2-a0c5fdd49654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.319826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac230ef-81b4-459b-a1f2-a0c5fdd49654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.319826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac230ef-81b4-459b-a1f2-a0c5fdd49654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:49.319826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac230ef-81b4-459b-a1f2-a0c5fdd49654 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:49.332601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 979/1950] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:49.337836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac230ef-81b4-459b-a1f2-a0c5fdd49654 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:49.350999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac230ef-81b4-459b-a1f2-a0c5fdd49654 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:49.359791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad2e29-0eff-4a97-ba09-5af04ffe9383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:49.360714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad2e29-0eff-4a97-ba09-5af04ffe9383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.361999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad2e29-0eff-4a97-ba09-5af04ffe9383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.361999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad2e29-0eff-4a97-ba09-5af04ffe9383 admin admin] PATH_INFO: `/v3/projects/20d6b174712e48eda0ec5ff17da1646c/users/ca26677f1c4340fbab8885c5d0a7b919/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.363054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c20eb-57ca-48f2-a4a1-63920255f8c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:49.365171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c20eb-57ca-48f2-a4a1-63920255f8c7 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:49.367939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad2e29-0eff-4a97-ba09-5af04ffe9383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d6b174712e48eda0ec5ff17da1646c, user_id=ca26677f1c4340fbab8885c5d0a7b919, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:49.372865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad2e29-0eff-4a97-ba09-5af04ffe9383 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:49.383282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 972/1951] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:49.397997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 980/1952] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:49 2022] PUT /identity/v3/projects/20d6b174712e48eda0ec5ff17da1646c/users/ca26677f1c4340fbab8885c5d0a7b919/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:49.399944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12881591-54d3-47e9-abaf-2c16bbe3d545 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.400241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12881591-54d3-47e9-abaf-2c16bbe3d545 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.401046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12881591-54d3-47e9-abaf-2c16bbe3d545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.437292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-12881591-54d3-47e9-abaf-2c16bbe3d545 None None] MFA Rules not processed for user `ca26677f1c4340fbab8885c5d0a7b919`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:49.438804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-12881591-54d3-47e9-abaf-2c16bbe3d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:49.465579 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad2e29-0eff-4a97-ba09-5af04ffe9383 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:49.468020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-68ad2e29-0eff-4a97-ba09-5af04ffe9383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:49.516182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 973/1953] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:49.530484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12881591-54d3-47e9-abaf-2c16bbe3d545 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:49.532055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-12881591-54d3-47e9-abaf-2c16bbe3d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:49.547032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad2e29-0eff-4a97-ba09-5af04ffe9383 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:49.552669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:49.553589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.553874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.554645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] PATH_INFO: `/v3/projects/874b92c48f1a4994a1ad20708898fc0c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.555382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=874b92c48f1a4994a1ad20708898fc0c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:49.557358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:49.614041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12881591-54d3-47e9-abaf-2c16bbe3d545 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:49.618784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59badb-be7b-4023-a537-c3146caef8b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:49.619118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59badb-be7b-4023-a537-c3146caef8b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.619523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59badb-be7b-4023-a537-c3146caef8b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.619812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59badb-be7b-4023-a537-c3146caef8b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.631043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59badb-be7b-4023-a537-c3146caef8b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:49.632849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59badb-be7b-4023-a537-c3146caef8b9 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:49.643165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:49.655860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 974/1954] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:49 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:49.658942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874b92c48f1a4994a1ad20708898fc0c', 'request_id': 'req-c812b353-278c-4235-83a0-27f531330961'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:49.666732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874b92c48f1a4994a1ad20708898fc0c', 'request_id': 'req-c812b353-278c-4235-83a0-27f531330961'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:49.690016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:49.762214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874b92c48f1a4994a1ad20708898fc0c', 'request_id': 'req-c812b353-278c-4235-83a0-27f531330961'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:49.787210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] The token cache is being invalidate because project 874b92c48f1a4994a1ad20708898fc0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:49.787210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:49.787210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c812b353-278c-4235-83a0-27f531330961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:49.787905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 981/1955] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:49 2022] DELETE /identity/v3/projects/874b92c48f1a4994a1ad20708898fc0c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:49.793175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ec49-b700-478f-96a7-d4f8d00f2cfa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.793616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ec49-b700-478f-96a7-d4f8d00f2cfa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.793895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ec49-b700-478f-96a7-d4f8d00f2cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.815845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a4d2ec49-b700-478f-96a7-d4f8d00f2cfa None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:49.817030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a4d2ec49-b700-478f-96a7-d4f8d00f2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:49.876025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 975/1956] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:49.883783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d51c-0859-4193-8b8c-26e20d6b50a0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.884066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d51c-0859-4193-8b8c-26e20d6b50a0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.884340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d51c-0859-4193-8b8c-26e20d6b50a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.906528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-66f5d51c-0859-4193-8b8c-26e20d6b50a0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:49.907786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-66f5d51c-0859-4193-8b8c-26e20d6b50a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:49.915538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 982/1957] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:49.919871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ec49-b700-478f-96a7-d4f8d00f2cfa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:49.929261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ec49-b700-478f-96a7-d4f8d00f2cfa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:49.933837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d44cb2-0e30-4efa-9364-a8743cd05c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:49.934484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d44cb2-0e30-4efa-9364-a8743cd05c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.934765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d44cb2-0e30-4efa-9364-a8743cd05c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.935041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d44cb2-0e30-4efa-9364-a8743cd05c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.935842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d44cb2-0e30-4efa-9364-a8743cd05c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:49.936149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d44cb2-0e30-4efa-9364-a8743cd05c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:49.937722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d44cb2-0e30-4efa-9364-a8743cd05c01 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:49.949667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 976/1958] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:49.953725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d51c-0859-4193-8b8c-26e20d6b50a0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:49.962735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d51c-0859-4193-8b8c-26e20d6b50a0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:49.968248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141bb3-43ac-4c1a-9a79-9e4f3230b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:49.968920 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141bb3-43ac-4c1a-9a79-9e4f3230b397 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:49.969202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141bb3-43ac-4c1a-9a79-9e4f3230b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:49.969995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141bb3-43ac-4c1a-9a79-9e4f3230b397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:49.970150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141bb3-43ac-4c1a-9a79-9e4f3230b397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:49.972110 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141bb3-43ac-4c1a-9a79-9e4f3230b397 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:50.056193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 983/1959] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:49 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:50.060241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d44cb2-0e30-4efa-9364-a8743cd05c01 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:50.070185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d44cb2-0e30-4efa-9364-a8743cd05c01 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:50.133565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d3fd-f098-4c9a-830d-a0f7366cbd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:50.133565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d3fd-f098-4c9a-830d-a0f7366cbd94 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:50.133565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d3fd-f098-4c9a-830d-a0f7366cbd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:50.137790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d3fd-f098-4c9a-830d-a0f7366cbd94 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:50.137790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526d3fd-f098-4c9a-830d-a0f7366cbd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:50.137790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526d3fd-f098-4c9a-830d-a0f7366cbd94 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:50.139749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141bb3-43ac-4c1a-9a79-9e4f3230b397 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:50.141717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2f141bb3-43ac-4c1a-9a79-9e4f3230b397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:50.208096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141bb3-43ac-4c1a-9a79-9e4f3230b397 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:50.215022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14f9b8-075b-4df7-87fd-8c1a4d9b1ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:50.215791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f9b8-075b-4df7-87fd-8c1a4d9b1ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:50.216123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f9b8-075b-4df7-87fd-8c1a4d9b1ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:50.221063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f9b8-075b-4df7-87fd-8c1a4d9b1ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:50.221264 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 977/1960] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:50 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:50.221343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dd14f9b8-075b-4df7-87fd-8c1a4d9b1ba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:50.223833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d3fd-f098-4c9a-830d-a0f7366cbd94 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:50.236099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d3fd-f098-4c9a-830d-a0f7366cbd94 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:50.241767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19558c-ea24-46c8-a6c7-579c18f49416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:50.243002 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19558c-ea24-46c8-a6c7-579c18f49416 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:50.243465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19558c-ea24-46c8-a6c7-579c18f49416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:50.243673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19558c-ea24-46c8-a6c7-579c18f49416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:50.244930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19558c-ea24-46c8-a6c7-579c18f49416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:50.247134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19558c-ea24-46c8-a6c7-579c18f49416 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:50.266536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 978/1961] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:50.272183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19558c-ea24-46c8-a6c7-579c18f49416 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:50.284209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19558c-ea24-46c8-a6c7-579c18f49416 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:50.289659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d14a0d-47f4-430f-946e-86f62c397b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:50.290480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d14a0d-47f4-430f-946e-86f62c397b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:50.290672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d14a0d-47f4-430f-946e-86f62c397b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:50.291013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d14a0d-47f4-430f-946e-86f62c397b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:50.291774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d14a0d-47f4-430f-946e-86f62c397b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:50.291909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14f9b8-075b-4df7-87fd-8c1a4d9b1ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:50.293826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d14a0d-47f4-430f-946e-86f62c397b98 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:50.293954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14f9b8-075b-4df7-87fd-8c1a4d9b1ba1 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:50.305246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 979/1962] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:50.309942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d14a0d-47f4-430f-946e-86f62c397b98 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:50.317440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 984/1963] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:50.325429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d14a0d-47f4-430f-946e-86f62c397b98 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:50.331209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9fe4-d341-44c6-b5bd-f05555fa5c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:50.331753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9fe4-d341-44c6-b5bd-f05555fa5c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:50.332105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9fe4-d341-44c6-b5bd-f05555fa5c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:50.332463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9fe4-d341-44c6-b5bd-f05555fa5c95 admin admin] PATH_INFO: `/v3/projects/b4dd2535b9924220a173a94c3cd4c70c/users/f8b217ce1ef4481685e40fa48d638074/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:50.352834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf9fe4-d341-44c6-b5bd-f05555fa5c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4dd2535b9924220a173a94c3cd4c70c, user_id=f8b217ce1ef4481685e40fa48d638074, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:50.354037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf9fe4-d341-44c6-b5bd-f05555fa5c95 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:50.415721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 980/1964] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:50 2022] PUT /identity/v3/projects/b4dd2535b9924220a173a94c3cd4c70c/users/f8b217ce1ef4481685e40fa48d638074/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:50.421086 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051f1c-9bbb-41c0-8db8-078b32f11efb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:50.421379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051f1c-9bbb-41c0-8db8-078b32f11efb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:50.421653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051f1c-9bbb-41c0-8db8-078b32f11efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:50.443739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b7051f1c-9bbb-41c0-8db8-078b32f11efb None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:50.445067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b7051f1c-9bbb-41c0-8db8-078b32f11efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:50.508027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 985/1965] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:50.517641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9fe4-d341-44c6-b5bd-f05555fa5c95 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:50.519545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8abf9fe4-d341-44c6-b5bd-f05555fa5c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:50.581167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9fe4-d341-44c6-b5bd-f05555fa5c95 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:50.584829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb2f3a-e600-454a-9346-68c764c02290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:50.585483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb2f3a-e600-454a-9346-68c764c02290 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:50.585766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb2f3a-e600-454a-9346-68c764c02290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:50.586043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb2f3a-e600-454a-9346-68c764c02290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:50.595387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:50.595666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb2f3a-e600-454a-9346-68c764c02290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:50.597450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb2f3a-e600-454a-9346-68c764c02290 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:50.609600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 981/1966] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:50.709418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:51.389348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:51.443845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:51.926534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:51.975279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:52.023799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c323e-6f69-40ca-bb75-755afbffbb05 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.028816 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c323e-6f69-40ca-bb75-755afbffbb05 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.029147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c323e-6f69-40ca-bb75-755afbffbb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.104547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-514c323e-6f69-40ca-bb75-755afbffbb05 None None] MFA Rules not processed for user `f8b217ce1ef4481685e40fa48d638074`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:52.105782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-514c323e-6f69-40ca-bb75-755afbffbb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:52.171214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:52.203749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 986/1967] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:52.211694 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb2f3a-e600-454a-9346-68c764c02290 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:52.221398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb2f3a-e600-454a-9346-68c764c02290 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:52.230561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2302654-8fcb-476c-a8b2-37b051b92410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:52.231275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302654-8fcb-476c-a8b2-37b051b92410 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.233955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302654-8fcb-476c-a8b2-37b051b92410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.233955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302654-8fcb-476c-a8b2-37b051b92410 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.233955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2302654-8fcb-476c-a8b2-37b051b92410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:52.234465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2302654-8fcb-476c-a8b2-37b051b92410 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:52.319951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 982/1968] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:52 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:52.320319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c323e-6f69-40ca-bb75-755afbffbb05 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:52.332134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c323e-6f69-40ca-bb75-755afbffbb05 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:52.390903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6019b3-0323-4382-a8cd-1fdb08f77c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:52.391610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6019b3-0323-4382-a8cd-1fdb08f77c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.391891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6019b3-0323-4382-a8cd-1fdb08f77c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.392163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6019b3-0323-4382-a8cd-1fdb08f77c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.392852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6019b3-0323-4382-a8cd-1fdb08f77c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:52.394907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6019b3-0323-4382-a8cd-1fdb08f77c6e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:52.494452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 987/1969] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:52 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:52.498651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2302654-8fcb-476c-a8b2-37b051b92410 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:52.508872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2302654-8fcb-476c-a8b2-37b051b92410 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:52.513477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01381869-714b-496a-a761-c665dd34c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:52.514126 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01381869-714b-496a-a761-c665dd34c9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.514406 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01381869-714b-496a-a761-c665dd34c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.514679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01381869-714b-496a-a761-c665dd34c9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.515448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01381869-714b-496a-a761-c665dd34c9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:52.517055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01381869-714b-496a-a761-c665dd34c9b4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:52.528170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 983/1970] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:52.535478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6019b3-0323-4382-a8cd-1fdb08f77c6e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:52.546284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6019b3-0323-4382-a8cd-1fdb08f77c6e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:52.551000 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d910d9-4cee-491e-927b-3325d221e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:52.551937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d910d9-4cee-491e-927b-3325d221e545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.552219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d910d9-4cee-491e-927b-3325d221e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.552539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d910d9-4cee-491e-927b-3325d221e545 admin admin] PATH_INFO: `/v3/projects/83d4881ebf52448fb2fef8d50bae21d8/users/d10da5a94dd5418b8933ca3bf2d505b2/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.569146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d910d9-4cee-491e-927b-3325d221e545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d4881ebf52448fb2fef8d50bae21d8, user_id=d10da5a94dd5418b8933ca3bf2d505b2, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:52.571838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d910d9-4cee-491e-927b-3325d221e545 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:52.604078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:52.637593 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 988/1971] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:52 2022] PUT /identity/v3/projects/83d4881ebf52448fb2fef8d50bae21d8/users/d10da5a94dd5418b8933ca3bf2d505b2/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:52.641415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01381869-714b-496a-a761-c665dd34c9b4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:52.652127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01381869-714b-496a-a761-c665dd34c9b4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:52.708295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e84a7-cdc9-4309-9b09-f82e7ab69fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:52.708959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e84a7-cdc9-4309-9b09-f82e7ab69fea admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.709245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e84a7-cdc9-4309-9b09-f82e7ab69fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.709522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e84a7-cdc9-4309-9b09-f82e7ab69fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.710266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e84a7-cdc9-4309-9b09-f82e7ab69fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:52.711905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e84a7-cdc9-4309-9b09-f82e7ab69fea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:52.725088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 984/1972] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:52.726215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d910d9-4cee-491e-927b-3325d221e545 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:52.733564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:52.738566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d910d9-4cee-491e-927b-3325d221e545 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:52.743070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04273345-14c3-44dd-b1ce-2874f3a6f756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:52.743970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04273345-14c3-44dd-b1ce-2874f3a6f756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.744272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04273345-14c3-44dd-b1ce-2874f3a6f756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.744588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04273345-14c3-44dd-b1ce-2874f3a6f756 admin admin] PATH_INFO: `/v3/projects/83d4881ebf52448fb2fef8d50bae21d8/users/d10da5a94dd5418b8933ca3bf2d505b2/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.746733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04273345-14c3-44dd-b1ce-2874f3a6f756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d4881ebf52448fb2fef8d50bae21d8, user_id=d10da5a94dd5418b8933ca3bf2d505b2, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:52.749344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04273345-14c3-44dd-b1ce-2874f3a6f756 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:52.759268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 989/1973] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:52 2022] PUT /identity/v3/projects/83d4881ebf52448fb2fef8d50bae21d8/users/d10da5a94dd5418b8933ca3bf2d505b2/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:52.777846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:53.090135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:53.143771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:53.520563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:53.700761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:54.078940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:54.106801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:54.121826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8706df-66cf-4ae5-b02e-7d06a4393caf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.122118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8706df-66cf-4ae5-b02e-7d06a4393caf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.122395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8706df-66cf-4ae5-b02e-7d06a4393caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.174802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3f8706df-66cf-4ae5-b02e-7d06a4393caf None None] MFA Rules not processed for user `d10da5a94dd5418b8933ca3bf2d505b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:54.176283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3f8706df-66cf-4ae5-b02e-7d06a4393caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.253454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 985/1974] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:13:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:54.265031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04273345-14c3-44dd-b1ce-2874f3a6f756 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.325169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04273345-14c3-44dd-b1ce-2874f3a6f756 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:54.328725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f78f0-53f7-4643-8bb5-7a79de82c007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:54.329370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f78f0-53f7-4643-8bb5-7a79de82c007 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.329663 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f78f0-53f7-4643-8bb5-7a79de82c007 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.329929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f78f0-53f7-4643-8bb5-7a79de82c007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.387768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f78f0-53f7-4643-8bb5-7a79de82c007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:54.389185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f78f0-53f7-4643-8bb5-7a79de82c007 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:54.398311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 990/1975] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:54.479087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:55.183982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:55.495042 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:55.586443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:58.252148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8706df-66cf-4ae5-b02e-7d06a4393caf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:58.261917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8706df-66cf-4ae5-b02e-7d06a4393caf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:58.266046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8eb93-1371-4364-af7c-4a715d33c337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:58.266762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8eb93-1371-4364-af7c-4a715d33c337 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:58.267045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8eb93-1371-4364-af7c-4a715d33c337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:58.267347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8eb93-1371-4364-af7c-4a715d33c337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:58.277801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8eb93-1371-4364-af7c-4a715d33c337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:58.279234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8eb93-1371-4364-af7c-4a715d33c337 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:58.288637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 986/1976] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:04.209846 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f78f0-53f7-4643-8bb5-7a79de82c007 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:04.211605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-db8f78f0-53f7-4643-8bb5-7a79de82c007 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:04.287618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f78f0-53f7-4643-8bb5-7a79de82c007 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:04.292872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:04.293761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.294036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.294304 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] PATH_INFO: `/v3/users/84bd0b7836cb45f1a97cd36e739dd719` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.295706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84bd0b7836cb45f1a97cd36e739dd719)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:04.297685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:04.487166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84bd0b7836cb45f1a97cd36e739dd719'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.489028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84bd0b7836cb45f1a97cd36e739dd719'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.490208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84bd0b7836cb45f1a97cd36e739dd719'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.498211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:04.503567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84bd0b7836cb45f1a97cd36e739dd719'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.512172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84bd0b7836cb45f1a97cd36e739dd719'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.589402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 991/1977] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:04 2022] DELETE /identity/v3/users/84bd0b7836cb45f1a97cd36e739dd719 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:04.593830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497614-4377-4934-9989-85dda62d3ff4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.594344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497614-4377-4934-9989-85dda62d3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.594444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497614-4377-4934-9989-85dda62d3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.620633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6b497614-4377-4934-9989-85dda62d3ff4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:04.622129 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6b497614-4377-4934-9989-85dda62d3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:04.691045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 987/1978] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:04.701241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:04.703663 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:04.768210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669acdc5-1f19-48f0-97ac-d87587f69271 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:04.772566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc4fe1-ba9a-4651-b40e-5d16e2b51ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:04.773222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc4fe1-ba9a-4651-b40e-5d16e2b51ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.774411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc4fe1-ba9a-4651-b40e-5d16e2b51ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.774411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc4fe1-ba9a-4651-b40e-5d16e2b51ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.784230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc4fe1-ba9a-4651-b40e-5d16e2b51ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:04.786461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc4fe1-ba9a-4651-b40e-5d16e2b51ba1 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:04.797417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 992/1979] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:05.366153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b497614-4377-4934-9989-85dda62d3ff4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:05.369279 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6b497614-4377-4934-9989-85dda62d3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:05.398783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b497614-4377-4934-9989-85dda62d3ff4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:05.404541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:05.405727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.406014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.406478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] PATH_INFO: `/v3/projects/52b36cbab99143a086a96aca91a9f5f1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.407893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b36cbab99143a086a96aca91a9f5f1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:05.409842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:05.562341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b36cbab99143a086a96aca91a9f5f1', 'request_id': 'req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:05.587304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b36cbab99143a086a96aca91a9f5f1', 'request_id': 'req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:05.680331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b36cbab99143a086a96aca91a9f5f1', 'request_id': 'req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:05.714964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:05.731309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] The token cache is being invalidate because project 52b36cbab99143a086a96aca91a9f5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:05.731604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:05.732384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:05.737877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 988/1980] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:05 2022] DELETE /identity/v3/projects/52b36cbab99143a086a96aca91a9f5f1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:05.739356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc4fe1-ba9a-4651-b40e-5d16e2b51ba1 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:05.753198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc4fe1-ba9a-4651-b40e-5d16e2b51ba1 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:05.822857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:05.825105 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.825399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.825677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] PATH_INFO: `/v3/users/3f1c34859c5b452e8620e5865fbb3983` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.826919 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1c34859c5b452e8620e5865fbb3983)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:05.828869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:06.082951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1c34859c5b452e8620e5865fbb3983'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.083669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1c34859c5b452e8620e5865fbb3983'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.084425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1c34859c5b452e8620e5865fbb3983'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.124560 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:06.126068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:06.130528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1c34859c5b452e8620e5865fbb3983'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.141627 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d2b21-1a4d-41bd-938e-0c025bb3c78b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:06.147008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:06.148884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:06.149277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:06.149564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] PATH_INFO: `/v3/users/16e9457ee3064ad685e9182a28c24b7c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:06.152096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8f0c03e0-0351-4ce4-89b5-69f312fab18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1c34859c5b452e8620e5865fbb3983'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.160632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e9457ee3064ad685e9182a28c24b7c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:06.160632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:06.164457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:06.245591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 993/1981] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:05 2022] DELETE /identity/v3/users/3f1c34859c5b452e8620e5865fbb3983 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:06.431892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e9457ee3064ad685e9182a28c24b7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.433061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e9457ee3064ad685e9182a28c24b7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.450108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e9457ee3064ad685e9182a28c24b7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.457254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e9457ee3064ad685e9182a28c24b7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.458351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e9457ee3064ad685e9182a28c24b7c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.524695 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 989/1982] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:06 2022] DELETE /identity/v3/users/16e9457ee3064ad685e9182a28c24b7c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:06.530195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d24aab-fe1b-4c54-b88a-b5facb3edc52 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:06.530532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d24aab-fe1b-4c54-b88a-b5facb3edc52 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:06.530760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d24aab-fe1b-4c54-b88a-b5facb3edc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:06.550229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d4d24aab-fe1b-4c54-b88a-b5facb3edc52 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:06.551620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d4d24aab-fe1b-4c54-b88a-b5facb3edc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:06.618969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 994/1983] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:06.645181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:06.647048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:06.753843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ddb14-2d84-4dea-96c8-316f5474614c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:06.758814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aa8ab-d0a6-4bb5-9e54-4dc67f063bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:06.760501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa8ab-d0a6-4bb5-9e54-4dc67f063bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:06.760985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa8ab-d0a6-4bb5-9e54-4dc67f063bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:06.761432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa8ab-d0a6-4bb5-9e54-4dc67f063bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:06.773071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aa8ab-d0a6-4bb5-9e54-4dc67f063bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:06.775206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aa8ab-d0a6-4bb5-9e54-4dc67f063bd8 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:06.786763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 990/1984] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:07.107771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d24aab-fe1b-4c54-b88a-b5facb3edc52 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:07.109943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d4d24aab-fe1b-4c54-b88a-b5facb3edc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.129495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d24aab-fe1b-4c54-b88a-b5facb3edc52 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:07.135112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:07.136378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.136569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.137010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] PATH_INFO: `/v3/projects/b963f567300543acbeace1042f03eb29` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.138615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b963f567300543acbeace1042f03eb29)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:07.140468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:07.258355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aa8ab-d0a6-4bb5-9e54-4dc67f063bd8 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:07.261869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-584aa8ab-d0a6-4bb5-9e54-4dc67f063bd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.282297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aa8ab-d0a6-4bb5-9e54-4dc67f063bd8 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:07.282465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b963f567300543acbeace1042f03eb29', 'request_id': 'req-12673a44-b850-4178-b366-cfeec89fb47c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.288437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b963f567300543acbeace1042f03eb29', 'request_id': 'req-12673a44-b850-4178-b366-cfeec89fb47c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.386250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:07.387924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.388263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.391919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] PATH_INFO: `/v3/users/4a39ddf72ac0454e8390125a3c59723e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.392044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b963f567300543acbeace1042f03eb29', 'request_id': 'req-12673a44-b850-4178-b366-cfeec89fb47c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.392137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a39ddf72ac0454e8390125a3c59723e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:07.392137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:07.407799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] The token cache is being invalidate because project b963f567300543acbeace1042f03eb29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:07.407799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.409089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:07.410776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.413036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 995/1985] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:07 2022] DELETE /identity/v3/projects/b963f567300543acbeace1042f03eb29 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:07.413299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:07.417259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.434750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12673a44-b850-4178-b366-cfeec89fb47c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:07.448412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:07.449334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.449617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.449916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] PATH_INFO: `/v3/projects/48573b1be26f4990b1318b337d5273df` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.451164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48573b1be26f4990b1318b337d5273df)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:07.453059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:07.610997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a39ddf72ac0454e8390125a3c59723e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.612253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a39ddf72ac0454e8390125a3c59723e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.614093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48573b1be26f4990b1318b337d5273df', 'request_id': 'req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.624767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48573b1be26f4990b1318b337d5273df', 'request_id': 'req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.628796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a39ddf72ac0454e8390125a3c59723e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.637030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a39ddf72ac0454e8390125a3c59723e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.637837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a39ddf72ac0454e8390125a3c59723e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.694794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48573b1be26f4990b1318b337d5273df', 'request_id': 'req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.707869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] The token cache is being invalidate because project 48573b1be26f4990b1318b337d5273df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:07.710207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.710207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.710640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 996/1986] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:07 2022] DELETE /identity/v3/projects/48573b1be26f4990b1318b337d5273df => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:07.714091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:07.714091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.718373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:07.781680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbe9a-8eeb-4e05-8b87-19f7c6626870 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:07.786275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:07.791394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.796538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.796538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] PATH_INFO: `/v3/users/a752d950f7cf488e8f8fa30f246737d1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.796538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a752d950f7cf488e8f8fa30f246737d1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:07.796827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 991/1987] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:07 2022] DELETE /identity/v3/users/4a39ddf72ac0454e8390125a3c59723e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:07.797261 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:07.797356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:07.799774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.865190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44993e7-4646-4ea4-83e7-3d82779f256d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:07.872336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:07.873678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.873966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.874245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] PATH_INFO: `/v3/users/6dca8278de574d4b982957f6de19b227` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.875508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dca8278de574d4b982957f6de19b227)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:07.877598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:08.017436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a752d950f7cf488e8f8fa30f246737d1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.018168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a752d950f7cf488e8f8fa30f246737d1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.018906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a752d950f7cf488e8f8fa30f246737d1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.031211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a752d950f7cf488e8f8fa30f246737d1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.039603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0d8a1c16-0f25-4c20-810a-db8b190296cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a752d950f7cf488e8f8fa30f246737d1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.113605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dca8278de574d4b982957f6de19b227'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.114292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dca8278de574d4b982957f6de19b227'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.127074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dca8278de574d4b982957f6de19b227'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.128837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 997/1988] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:07 2022] DELETE /identity/v3/users/a752d950f7cf488e8f8fa30f246737d1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:08.131982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec3c8f-548e-4832-a985-e2d8d7cf65dc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.131982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec3c8f-548e-4832-a985-e2d8d7cf65dc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.131982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec3c8f-548e-4832-a985-e2d8d7cf65dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.149424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a5ec3c8f-548e-4832-a985-e2d8d7cf65dc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:08.151076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a5ec3c8f-548e-4832-a985-e2d8d7cf65dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.154259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dca8278de574d4b982957f6de19b227'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.155124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dca8278de574d4b982957f6de19b227'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.213820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 998/1989] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:08.223389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec3c8f-548e-4832-a985-e2d8d7cf65dc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:08.224903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a5ec3c8f-548e-4832-a985-e2d8d7cf65dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.239089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 992/1990] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:07 2022] DELETE /identity/v3/users/6dca8278de574d4b982957f6de19b227 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:08.287114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec3c8f-548e-4832-a985-e2d8d7cf65dc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:08.337819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55566-413a-440b-9f84-4ad10dc2ebf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:08.338478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55566-413a-440b-9f84-4ad10dc2ebf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.338904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55566-413a-440b-9f84-4ad10dc2ebf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.339292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55566-413a-440b-9f84-4ad10dc2ebf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.415292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55566-413a-440b-9f84-4ad10dc2ebf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:08.415292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55566-413a-440b-9f84-4ad10dc2ebf2 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:08.416228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 999/1991] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:08.697202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:08.698083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55566-413a-440b-9f84-4ad10dc2ebf2 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:08.699398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.699645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dcf55566-413a-440b-9f84-4ad10dc2ebf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.712883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55566-413a-440b-9f84-4ad10dc2ebf2 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:08.719346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:08.720351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.721002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.721002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] PATH_INFO: `/v3/projects/80e4eeca8285406c923f3e7b489fab8b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.722105 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e4eeca8285406c923f3e7b489fab8b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:08.725052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:08.725178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5b135-1757-4ebe-999d-1749ed064a15 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:08.732704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:08.733782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.734292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.734711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] PATH_INFO: `/v3/projects/a332d44acd264957ac4ecf5b40932ca7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.739899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a332d44acd264957ac4ecf5b40932ca7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:08.740363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:08.743228 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:08.746138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:08.850563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a332d44acd264957ac4ecf5b40932ca7', 'request_id': 'req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.858161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a332d44acd264957ac4ecf5b40932ca7', 'request_id': 'req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.882340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e4eeca8285406c923f3e7b489fab8b', 'request_id': 'req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.889172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e4eeca8285406c923f3e7b489fab8b', 'request_id': 'req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.936194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a332d44acd264957ac4ecf5b40932ca7', 'request_id': 'req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.949189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] The token cache is being invalidate because project a332d44acd264957ac4ecf5b40932ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:08.949572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.950390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a22bc233-5a4f-435a-a8ba-c9faa24aa67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.956554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 993/1992] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:08 2022] DELETE /identity/v3/projects/a332d44acd264957ac4ecf5b40932ca7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:08.958359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a10828-c46f-4193-ba02-c5dbb54f545e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.959135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a10828-c46f-4193-ba02-c5dbb54f545e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.959135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a10828-c46f-4193-ba02-c5dbb54f545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.981130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-89a10828-c46f-4193-ba02-c5dbb54f545e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:08.983153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-89a10828-c46f-4193-ba02-c5dbb54f545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.064043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 994/1993] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:09.072389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33daca2-358d-4b2f-b3bc-ac985f9d87ca None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.073018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33daca2-358d-4b2f-b3bc-ac985f9d87ca None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.073557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33daca2-358d-4b2f-b3bc-ac985f9d87ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.076540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e4eeca8285406c923f3e7b489fab8b', 'request_id': 'req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.091950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] The token cache is being invalidate because project 80e4eeca8285406c923f3e7b489fab8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:09.092250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.093342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d40b7a2e-5c6b-4fe2-a0c0-dcbeade943ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.096137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1000/1994] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:08 2022] DELETE /identity/v3/projects/80e4eeca8285406c923f3e7b489fab8b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:09.103622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fc4b3-86ad-4d9b-9710-7bd404a4b170 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.103622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fc4b3-86ad-4d9b-9710-7bd404a4b170 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.103981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fc4b3-86ad-4d9b-9710-7bd404a4b170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.108212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c33daca2-358d-4b2f-b3bc-ac985f9d87ca None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:09.111690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c33daca2-358d-4b2f-b3bc-ac985f9d87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.125835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8f5fc4b3-86ad-4d9b-9710-7bd404a4b170 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:09.127750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8f5fc4b3-86ad-4d9b-9710-7bd404a4b170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.135397 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 995/1995] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:09.139829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1001/1996] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:09.150847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b068a-9628-4003-9c2b-8f560d8d4b16 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.150956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33daca2-358d-4b2f-b3bc-ac985f9d87ca None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.151065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b068a-9628-4003-9c2b-8f560d8d4b16 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.151065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b068a-9628-4003-9c2b-8f560d8d4b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.158950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33daca2-358d-4b2f-b3bc-ac985f9d87ca None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.164731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedacfa4-a186-4a0d-9986-67037419eb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.166478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedacfa4-a186-4a0d-9986-67037419eb9e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.167382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedacfa4-a186-4a0d-9986-67037419eb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.167382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedacfa4-a186-4a0d-9986-67037419eb9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.167969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedacfa4-a186-4a0d-9986-67037419eb9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:09.168509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedacfa4-a186-4a0d-9986-67037419eb9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.169697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-437b068a-9628-4003-9c2b-8f560d8d4b16 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:09.170181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedacfa4-a186-4a0d-9986-67037419eb9e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.170899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-437b068a-9628-4003-9c2b-8f560d8d4b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.178844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1002/1997] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:09.182753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 996/1998] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:09.183300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b068a-9628-4003-9c2b-8f560d8d4b16 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.187054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedacfa4-a186-4a0d-9986-67037419eb9e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.192191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b068a-9628-4003-9c2b-8f560d8d4b16 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.197039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef35ec-8f2d-4851-9d92-2ddba2684283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.197683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef35ec-8f2d-4851-9d92-2ddba2684283 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.197969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef35ec-8f2d-4851-9d92-2ddba2684283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.198247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef35ec-8f2d-4851-9d92-2ddba2684283 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.198969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef35ec-8f2d-4851-9d92-2ddba2684283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:09.199320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef35ec-8f2d-4851-9d92-2ddba2684283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.200910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef35ec-8f2d-4851-9d92-2ddba2684283 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.210236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedacfa4-a186-4a0d-9986-67037419eb9e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.216462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1003/1999] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:14:09.216599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b6dc0-8728-4e21-8c27-d7233dc71ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.216599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b6dc0-8728-4e21-8c27-d7233dc71ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.216599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b6dc0-8728-4e21-8c27-d7233dc71ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.216599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b6dc0-8728-4e21-8c27-d7233dc71ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.217406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef35ec-8f2d-4851-9d92-2ddba2684283 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.217821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b6dc0-8728-4e21-8c27-d7233dc71ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.219793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b6dc0-8728-4e21-8c27-d7233dc71ad1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.227049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef35ec-8f2d-4851-9d92-2ddba2684283 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.240751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f047de-ea41-495e-8c9a-0646178b0d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.241424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f047de-ea41-495e-8c9a-0646178b0d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.241701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f047de-ea41-495e-8c9a-0646178b0d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.241978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f047de-ea41-495e-8c9a-0646178b0d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.242670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f047de-ea41-495e-8c9a-0646178b0d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.244683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f047de-ea41-495e-8c9a-0646178b0d06 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.299499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 997/2000] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:09 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:09.300499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b6dc0-8728-4e21-8c27-d7233dc71ad1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.303915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c56b6dc0-8728-4e21-8c27-d7233dc71ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.322412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1004/2001] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:09 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:09.324094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f047de-ea41-495e-8c9a-0646178b0d06 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.367458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b6dc0-8728-4e21-8c27-d7233dc71ad1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.391787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f047de-ea41-495e-8c9a-0646178b0d06 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.396437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf2ee5-6a1f-44cf-b334-5cf07c9151d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.397107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2ee5-6a1f-44cf-b334-5cf07c9151d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.397384 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2ee5-6a1f-44cf-b334-5cf07c9151d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.397653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2ee5-6a1f-44cf-b334-5cf07c9151d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.398334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf2ee5-6a1f-44cf-b334-5cf07c9151d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.400964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf2ee5-6a1f-44cf-b334-5cf07c9151d8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.427613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.428480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.428763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.429036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] PATH_INFO: `/v3/projects/47ed112001494598af382a9dd0e27f35` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.430218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ed112001494598af382a9dd0e27f35)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.432202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.560020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1005/2002] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:09 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:09.561400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf2ee5-6a1f-44cf-b334-5cf07c9151d8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.572794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf2ee5-6a1f-44cf-b334-5cf07c9151d8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.578388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ed112001494598af382a9dd0e27f35', 'request_id': 'req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.585504 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ed112001494598af382a9dd0e27f35', 'request_id': 'req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.631721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287180f-e144-4e9d-8e7e-031c639821f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.633105 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287180f-e144-4e9d-8e7e-031c639821f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.633428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287180f-e144-4e9d-8e7e-031c639821f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.633703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287180f-e144-4e9d-8e7e-031c639821f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.635123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287180f-e144-4e9d-8e7e-031c639821f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.637090 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287180f-e144-4e9d-8e7e-031c639821f4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.674449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ed112001494598af382a9dd0e27f35', 'request_id': 'req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.687380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] The token cache is being invalidate because project 47ed112001494598af382a9dd0e27f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:09.687659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.688323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.689954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 998/2003] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:09 2022] DELETE /identity/v3/projects/47ed112001494598af382a9dd0e27f35 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:09.690786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.692137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.705123 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50d1d-cef2-405c-b7ef-4c66872ab9d6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.710177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc007a-53a8-49f8-af5a-7c7a903a6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.710854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc007a-53a8-49f8-af5a-7c7a903a6c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.711166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc007a-53a8-49f8-af5a-7c7a903a6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.711448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc007a-53a8-49f8-af5a-7c7a903a6c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.712215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc007a-53a8-49f8-af5a-7c7a903a6c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.713879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc007a-53a8-49f8-af5a-7c7a903a6c21 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.724008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 999/2004] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:09.724883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc007a-53a8-49f8-af5a-7c7a903a6c21 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.727975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d3fc007a-53a8-49f8-af5a-7c7a903a6c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.741323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc007a-53a8-49f8-af5a-7c7a903a6c21 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.746996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.747901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.748193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.748469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] PATH_INFO: `/v3/users/ca26677f1c4340fbab8885c5d0a7b919` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.749674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca26677f1c4340fbab8885c5d0a7b919)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.751648 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.772162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1006/2005] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:09 2022] POST /identity/v3/users => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:09.773139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287180f-e144-4e9d-8e7e-031c639821f4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.786271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287180f-e144-4e9d-8e7e-031c639821f4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.792089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cac64-c974-4d16-a7a3-453cb4ddd98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.795136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cac64-c974-4d16-a7a3-453cb4ddd98e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.795136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cac64-c974-4d16-a7a3-453cb4ddd98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.795136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cac64-c974-4d16-a7a3-453cb4ddd98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.795136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cac64-c974-4d16-a7a3-453cb4ddd98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.795627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cac64-c974-4d16-a7a3-453cb4ddd98e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.808486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1007/2006] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:09.809512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cac64-c974-4d16-a7a3-453cb4ddd98e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.811211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c91cac64-c974-4d16-a7a3-453cb4ddd98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.824120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cac64-c974-4d16-a7a3-453cb4ddd98e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.828835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6cf71-407a-42b0-baba-3df74c2bd87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.829467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6cf71-407a-42b0-baba-3df74c2bd87b admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.829749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6cf71-407a-42b0-baba-3df74c2bd87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.830023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6cf71-407a-42b0-baba-3df74c2bd87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.830726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6cf71-407a-42b0-baba-3df74c2bd87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.832344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6cf71-407a-42b0-baba-3df74c2bd87b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.841851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1008/2007] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:09.842732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6cf71-407a-42b0-baba-3df74c2bd87b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.854314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6cf71-407a-42b0-baba-3df74c2bd87b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.858977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a1b2-9bbe-46f5-b1d1-b5c75d35af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.859899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a1b2-9bbe-46f5-b1d1-b5c75d35af82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.860183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a1b2-9bbe-46f5-b1d1-b5c75d35af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.860455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a1b2-9bbe-46f5-b1d1-b5c75d35af82 admin admin] PATH_INFO: `/v3/projects/e182c0fa42004b6da5da2d4a405fd44e/users/eb125bc3f43049d4b9bb836b170b81de/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.875603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71a1b2-9bbe-46f5-b1d1-b5c75d35af82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e182c0fa42004b6da5da2d4a405fd44e, user_id=eb125bc3f43049d4b9bb836b170b81de, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.878360 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71a1b2-9bbe-46f5-b1d1-b5c75d35af82 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.971651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1009/2008] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:09 2022] PUT /identity/v3/projects/e182c0fa42004b6da5da2d4a405fd44e/users/eb125bc3f43049d4b9bb836b170b81de/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:09.972478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a1b2-9bbe-46f5-b1d1-b5c75d35af82 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.981221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca26677f1c4340fbab8885c5d0a7b919'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.981876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca26677f1c4340fbab8885c5d0a7b919'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.994356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca26677f1c4340fbab8885c5d0a7b919'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.001318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca26677f1c4340fbab8885c5d0a7b919'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.001999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca26677f1c4340fbab8885c5d0a7b919'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.035655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a1b2-9bbe-46f5-b1d1-b5c75d35af82 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.041184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5076c-3958-44c8-be60-156f443662cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.041771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5076c-3958-44c8-be60-156f443662cc admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.041771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5076c-3958-44c8-be60-156f443662cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.041972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5076c-3958-44c8-be60-156f443662cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.042712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5076c-3958-44c8-be60-156f443662cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.044356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5076c-3958-44c8-be60-156f443662cc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.053982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1010/2009] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:10.055150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226671a-e15a-4934-96f1-bed4103d4bd5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.055434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226671a-e15a-4934-96f1-bed4103d4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.055701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226671a-e15a-4934-96f1-bed4103d4bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.068782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1000/2010] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:09 2022] DELETE /identity/v3/users/ca26677f1c4340fbab8885c5d0a7b919 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:10.069801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.071301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.088518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3226671a-e15a-4934-96f1-bed4103d4bd5 None None] MFA Rules not processed for user `eb125bc3f43049d4b9bb836b170b81de`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:10.089748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3226671a-e15a-4934-96f1-bed4103d4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.141940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cf956-24dc-4660-b014-4d2cbbe3343d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.151781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7e8f7-a7c7-4953-97af-4a9012cc80b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.152857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e8f7-a7c7-4953-97af-4a9012cc80b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.154659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e8f7-a7c7-4953-97af-4a9012cc80b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.155581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e8f7-a7c7-4953-97af-4a9012cc80b2 admin admin] PATH_INFO: `/v3/projects/a69404f7ed1a4a0ab8f5b3b28063d6d3/users/8675fba9ab304b7cb1b56857b96ad533/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.158290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:10.169532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1011/2011] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:10.180964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226671a-e15a-4934-96f1-bed4103d4bd5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.183381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3226671a-e15a-4934-96f1-bed4103d4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.187893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7e8f7-a7c7-4953-97af-4a9012cc80b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69404f7ed1a4a0ab8f5b3b28063d6d3, user_id=8675fba9ab304b7cb1b56857b96ad533, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.190693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7e8f7-a7c7-4953-97af-4a9012cc80b2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.244222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226671a-e15a-4934-96f1-bed4103d4bd5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.248349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b1f75-1d68-4ece-8818-29b64679ec62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.249128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b1f75-1d68-4ece-8818-29b64679ec62 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.249313 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b1f75-1d68-4ece-8818-29b64679ec62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.249560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b1f75-1d68-4ece-8818-29b64679ec62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.258757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b1f75-1d68-4ece-8818-29b64679ec62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.260260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b1f75-1d68-4ece-8818-29b64679ec62 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.274353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1012/2012] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:10.296081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b1f75-1d68-4ece-8818-29b64679ec62 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.297908 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-662b1f75-1d68-4ece-8818-29b64679ec62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.314870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1001/2013] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:10 2022] PUT /identity/v3/projects/a69404f7ed1a4a0ab8f5b3b28063d6d3/users/8675fba9ab304b7cb1b56857b96ad533/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:10.323326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b1f75-1d68-4ece-8818-29b64679ec62 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.323472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:10.326277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c203-c227-403a-ba8d-e6abb006fe69 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.326670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c203-c227-403a-ba8d-e6abb006fe69 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.327048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c203-c227-403a-ba8d-e6abb006fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.362900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4201c203-c227-403a-ba8d-e6abb006fe69 None None] MFA Rules not processed for user `8675fba9ab304b7cb1b56857b96ad533`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:10.364463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4201c203-c227-403a-ba8d-e6abb006fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.392832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.393710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.393993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.394267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] PATH_INFO: `/v3/users/eb125bc3f43049d4b9bb836b170b81de` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.395972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb125bc3f43049d4b9bb836b170b81de)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.398428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.437624 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1002/2014] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:10.442055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c203-c227-403a-ba8d-e6abb006fe69 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.451845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c203-c227-403a-ba8d-e6abb006fe69 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.456359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e52ee-063a-40e7-a816-8fb062fe46b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.456981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e52ee-063a-40e7-a816-8fb062fe46b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.457261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e52ee-063a-40e7-a816-8fb062fe46b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.457535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e52ee-063a-40e7-a816-8fb062fe46b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.458202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e52ee-063a-40e7-a816-8fb062fe46b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.460134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e52ee-063a-40e7-a816-8fb062fe46b5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.564301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1003/2015] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:10.564301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e52ee-063a-40e7-a816-8fb062fe46b5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.564301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-064e52ee-063a-40e7-a816-8fb062fe46b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.626916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e52ee-063a-40e7-a816-8fb062fe46b5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.634867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.634867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.634867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.634867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] PATH_INFO: `/v3/projects/20d6b174712e48eda0ec5ff17da1646c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.635247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d6b174712e48eda0ec5ff17da1646c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.636253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.672425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb125bc3f43049d4b9bb836b170b81de'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.673299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb125bc3f43049d4b9bb836b170b81de'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.673978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb125bc3f43049d4b9bb836b170b81de'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.686441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb125bc3f43049d4b9bb836b170b81de'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.698431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb125bc3f43049d4b9bb836b170b81de'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.763324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d6b174712e48eda0ec5ff17da1646c', 'request_id': 'req-52947d81-9fcc-4fc9-8fbe-50c79f66496e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.769465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d6b174712e48eda0ec5ff17da1646c', 'request_id': 'req-52947d81-9fcc-4fc9-8fbe-50c79f66496e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.770803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:10.776882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1013/2016] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:10 2022] DELETE /identity/v3/users/eb125bc3f43049d4b9bb836b170b81de => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:10.777697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.779020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.842155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6efb4d-b1db-414a-b9a5-bf62e1cb8e70 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.846693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e71a9-7d52-41f4-bd2d-fc97220dfee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.847400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e71a9-7d52-41f4-bd2d-fc97220dfee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.847686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e71a9-7d52-41f4-bd2d-fc97220dfee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.847958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e71a9-7d52-41f4-bd2d-fc97220dfee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.848643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e71a9-7d52-41f4-bd2d-fc97220dfee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.850542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e71a9-7d52-41f4-bd2d-fc97220dfee6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.860299 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d6b174712e48eda0ec5ff17da1646c', 'request_id': 'req-52947d81-9fcc-4fc9-8fbe-50c79f66496e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.871302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] The token cache is being invalidate because project 20d6b174712e48eda0ec5ff17da1646c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:10.871591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.877166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-52947d81-9fcc-4fc9-8fbe-50c79f66496e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.877166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1004/2017] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:10 2022] DELETE /identity/v3/projects/20d6b174712e48eda0ec5ff17da1646c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:10.877166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473ec4-ecdd-459f-8186-d254520fa11c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.877166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473ec4-ecdd-459f-8186-d254520fa11c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.877166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473ec4-ecdd-459f-8186-d254520fa11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.891840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:10.893489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d1473ec4-ecdd-459f-8186-d254520fa11c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:10.894685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d1473ec4-ecdd-459f-8186-d254520fa11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.902871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1005/2018] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:10.904245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c81741-32ae-4aca-b0ff-6e2d00ba5b3e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.904539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c81741-32ae-4aca-b0ff-6e2d00ba5b3e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.904817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c81741-32ae-4aca-b0ff-6e2d00ba5b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.922073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-60c81741-32ae-4aca-b0ff-6e2d00ba5b3e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:10.923267 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-60c81741-32ae-4aca-b0ff-6e2d00ba5b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.931069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1006/2019] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:10.934892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c81741-32ae-4aca-b0ff-6e2d00ba5b3e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.934892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-60c81741-32ae-4aca-b0ff-6e2d00ba5b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.960266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1014/2020] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/users => generated 306 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:10.961423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa15ff-b093-4dc3-9786-8672f4331c1c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.961704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa15ff-b093-4dc3-9786-8672f4331c1c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.961981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa15ff-b093-4dc3-9786-8672f4331c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.980641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b4fa15ff-b093-4dc3-9786-8672f4331c1c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:10.981817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b4fa15ff-b093-4dc3-9786-8672f4331c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.988743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c81741-32ae-4aca-b0ff-6e2d00ba5b3e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.990442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1015/2021] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:10.991197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa15ff-b093-4dc3-9786-8672f4331c1c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.992711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da356c30-922a-4d92-90d0-17ee5a19df28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.993545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da356c30-922a-4d92-90d0-17ee5a19df28 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.993791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da356c30-922a-4d92-90d0-17ee5a19df28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.994065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da356c30-922a-4d92-90d0-17ee5a19df28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.994468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b4fa15ff-b093-4dc3-9786-8672f4331c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.003681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da356c30-922a-4d92-90d0-17ee5a19df28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.005185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da356c30-922a-4d92-90d0-17ee5a19df28 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.006266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa15ff-b093-4dc3-9786-8672f4331c1c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.011665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd19d1-2a60-478d-90c0-b6473deba180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.012421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd19d1-2a60-478d-90c0-b6473deba180 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.012698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd19d1-2a60-478d-90c0-b6473deba180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.012969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd19d1-2a60-478d-90c0-b6473deba180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.013677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd19d1-2a60-478d-90c0-b6473deba180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.015260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd19d1-2a60-478d-90c0-b6473deba180 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.016038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1007/2022] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:11.016830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da356c30-922a-4d92-90d0-17ee5a19df28 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.026879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da356c30-922a-4d92-90d0-17ee5a19df28 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.030678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1016/2023] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:11.032128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f83e6-2261-4e1a-9193-1505366750c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.032292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd19d1-2a60-478d-90c0-b6473deba180 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.032787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f83e6-2261-4e1a-9193-1505366750c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.033071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f83e6-2261-4e1a-9193-1505366750c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.033351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f83e6-2261-4e1a-9193-1505366750c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.034075 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f83e6-2261-4e1a-9193-1505366750c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:11.034384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f83e6-2261-4e1a-9193-1505366750c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.036013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f83e6-2261-4e1a-9193-1505366750c5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.042208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd19d1-2a60-478d-90c0-b6473deba180 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.047330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5b1c7-a090-43f2-8598-492b0c78db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.048216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5b1c7-a090-43f2-8598-492b0c78db54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.048491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5b1c7-a090-43f2-8598-492b0c78db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.048760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5b1c7-a090-43f2-8598-492b0c78db54 admin admin] PATH_INFO: `/v3/projects/2bc154b67abf46f5a267afbcd2ff4817/users/06e7d696fe3843ef867900658ca608e6/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.049404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1008/2024] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:11.053597 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f83e6-2261-4e1a-9193-1505366750c5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.065005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f83e6-2261-4e1a-9193-1505366750c5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.069570 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5b1c7-a090-43f2-8598-492b0c78db54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc154b67abf46f5a267afbcd2ff4817, user_id=06e7d696fe3843ef867900658ca608e6, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.070303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b704e-1cc8-4f63-9f54-2abc5305b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.071184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b704e-1cc8-4f63-9f54-2abc5305b9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.072006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b704e-1cc8-4f63-9f54-2abc5305b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.072262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b704e-1cc8-4f63-9f54-2abc5305b9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.072952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b704e-1cc8-4f63-9f54-2abc5305b9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.074085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5b1c7-a090-43f2-8598-492b0c78db54 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.074860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b704e-1cc8-4f63-9f54-2abc5305b9ea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.117481 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:11.180244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1017/2025] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:11 2022] PUT /identity/v3/projects/2bc154b67abf46f5a267afbcd2ff4817/users/06e7d696fe3843ef867900658ca608e6/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:11.184563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5b1c7-a090-43f2-8598-492b0c78db54 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.210811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1009/2026] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:11 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:11.215935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b704e-1cc8-4f63-9f54-2abc5305b9ea admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.279332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5b1c7-a090-43f2-8598-492b0c78db54 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.299796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b704e-1cc8-4f63-9f54-2abc5305b9ea admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.305745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c4c76-edd2-46f6-b521-49a8be1d224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.306952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c4c76-edd2-46f6-b521-49a8be1d224d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.307278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c4c76-edd2-46f6-b521-49a8be1d224d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.308338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c4c76-edd2-46f6-b521-49a8be1d224d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.308338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c4c76-edd2-46f6-b521-49a8be1d224d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.310147 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c4c76-edd2-46f6-b521-49a8be1d224d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.343847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347946-b2fd-4bb3-ae23-f1959e3ca8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.344518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347946-b2fd-4bb3-ae23-f1959e3ca8af admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.344796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347946-b2fd-4bb3-ae23-f1959e3ca8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.345067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347946-b2fd-4bb3-ae23-f1959e3ca8af admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.345783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347946-b2fd-4bb3-ae23-f1959e3ca8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.347438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347946-b2fd-4bb3-ae23-f1959e3ca8af admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.359128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1018/2027] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:11.364029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347946-b2fd-4bb3-ae23-f1959e3ca8af admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.377652 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347946-b2fd-4bb3-ae23-f1959e3ca8af admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.382688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf8f3c-7b5c-4d97-9abd-c05403b62409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.383617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf8f3c-7b5c-4d97-9abd-c05403b62409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.383905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf8f3c-7b5c-4d97-9abd-c05403b62409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.384726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf8f3c-7b5c-4d97-9abd-c05403b62409 admin admin] PATH_INFO: `/v3/projects/2bc154b67abf46f5a267afbcd2ff4817/users/06e7d696fe3843ef867900658ca608e6/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.386716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf8f3c-7b5c-4d97-9abd-c05403b62409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc154b67abf46f5a267afbcd2ff4817, user_id=06e7d696fe3843ef867900658ca608e6, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.389433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf8f3c-7b5c-4d97-9abd-c05403b62409 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.397974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1010/2028] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:11 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:11.401113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1019/2029] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:11 2022] PUT /identity/v3/projects/2bc154b67abf46f5a267afbcd2ff4817/users/06e7d696fe3843ef867900658ca608e6/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:11.409484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c4c76-edd2-46f6-b521-49a8be1d224d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.411323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3eb1-c8db-41ae-96b1-22ad7be35700 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.411688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3eb1-c8db-41ae-96b1-22ad7be35700 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.412040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3eb1-c8db-41ae-96b1-22ad7be35700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.415919 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:11.421559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c4c76-edd2-46f6-b521-49a8be1d224d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.444953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-334c3eb1-c8db-41ae-96b1-22ad7be35700 None None] MFA Rules not processed for user `06e7d696fe3843ef867900658ca608e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:11.447078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-334c3eb1-c8db-41ae-96b1-22ad7be35700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.500515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be31b-dd70-4a32-882b-46dc94f7f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.501200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be31b-dd70-4a32-882b-46dc94f7f9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.501486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be31b-dd70-4a32-882b-46dc94f7f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.501857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be31b-dd70-4a32-882b-46dc94f7f9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.502563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be31b-dd70-4a32-882b-46dc94f7f9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.504170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be31b-dd70-4a32-882b-46dc94f7f9aa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.511197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:11.516494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1011/2030] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:11.527112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be31b-dd70-4a32-882b-46dc94f7f9aa admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.527112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2a8be31b-dd70-4a32-882b-46dc94f7f9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.533470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be31b-dd70-4a32-882b-46dc94f7f9aa admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.537472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1020/2031] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:11.537472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c3eb1-c8db-41ae-96b1-22ad7be35700 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.542404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.543418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.543780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.544120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] PATH_INFO: `/v3/projects/e182c0fa42004b6da5da2d4a405fd44e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.545448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e182c0fa42004b6da5da2d4a405fd44e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.547449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.551173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c3eb1-c8db-41ae-96b1-22ad7be35700 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.556505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5dd66-41b0-40b4-a4d4-73354c5e98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.557149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5dd66-41b0-40b4-a4d4-73354c5e98f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.557436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5dd66-41b0-40b4-a4d4-73354c5e98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.557713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5dd66-41b0-40b4-a4d4-73354c5e98f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.558560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5dd66-41b0-40b4-a4d4-73354c5e98f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.560168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5dd66-41b0-40b4-a4d4-73354c5e98f4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.570839 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1021/2032] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:11.571357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5dd66-41b0-40b4-a4d4-73354c5e98f4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.573518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e1b5dd66-41b0-40b4-a4d4-73354c5e98f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.628944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5dd66-41b0-40b4-a4d4-73354c5e98f4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.642928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e182c0fa42004b6da5da2d4a405fd44e', 'request_id': 'req-6eff5e03-948b-43bf-83d0-808cb9950cb3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.649549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e182c0fa42004b6da5da2d4a405fd44e', 'request_id': 'req-6eff5e03-948b-43bf-83d0-808cb9950cb3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.680352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1f2e8-b843-419e-a6e0-be0585c8ceb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.682088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1f2e8-b843-419e-a6e0-be0585c8ceb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.683532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1f2e8-b843-419e-a6e0-be0585c8ceb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.683823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1f2e8-b843-419e-a6e0-be0585c8ceb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.712127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e182c0fa42004b6da5da2d4a405fd44e', 'request_id': 'req-6eff5e03-948b-43bf-83d0-808cb9950cb3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.727183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] The token cache is being invalidate because project e182c0fa42004b6da5da2d4a405fd44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:11.728201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.729255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.737298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1012/2033] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:11 2022] DELETE /identity/v3/projects/e182c0fa42004b6da5da2d4a405fd44e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:11.738691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.740764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.749271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1f2e8-b843-419e-a6e0-be0585c8ceb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.750726 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1f2e8-b843-419e-a6e0-be0585c8ceb9 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.761503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1022/2034] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:11.763019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5e843-5330-4677-b49b-00f8ac7bb1da None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.763448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5e843-5330-4677-b49b-00f8ac7bb1da None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.763769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5e843-5330-4677-b49b-00f8ac7bb1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.767171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:11.789226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-56e5e843-5330-4677-b49b-00f8ac7bb1da None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:11.790968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-56e5e843-5330-4677-b49b-00f8ac7bb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.792965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:11.817429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff5e03-948b-43bf-83d0-808cb9950cb3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.822404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea6127-5a34-493d-9e06-ff4372e6fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.823285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea6127-5a34-493d-9e06-ff4372e6fd1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.823573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea6127-5a34-493d-9e06-ff4372e6fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.823846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea6127-5a34-493d-9e06-ff4372e6fd1f admin admin] PATH_INFO: `/v3/projects/542bb8e17ee44f5a9fae0eb76e1068ef/users/7913a7c737e643d397ffbfff5e65a89a/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.843807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea6127-5a34-493d-9e06-ff4372e6fd1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=542bb8e17ee44f5a9fae0eb76e1068ef, user_id=7913a7c737e643d397ffbfff5e65a89a, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.846594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea6127-5a34-493d-9e06-ff4372e6fd1f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.855408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1023/2035] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:11.862817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dbf64-cf14-4d78-bd2a-e335f8b71e20 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.863123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dbf64-cf14-4d78-bd2a-e335f8b71e20 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.863421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dbf64-cf14-4d78-bd2a-e335f8b71e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.883926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6a9dbf64-cf14-4d78-bd2a-e335f8b71e20 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:11.885125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6a9dbf64-cf14-4d78-bd2a-e335f8b71e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.892977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1024/2036] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:11.897206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dbf64-cf14-4d78-bd2a-e335f8b71e20 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.906566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dbf64-cf14-4d78-bd2a-e335f8b71e20 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.911355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bcbe1-5fe9-4517-8183-530e88335e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.911990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bcbe1-5fe9-4517-8183-530e88335e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.912271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bcbe1-5fe9-4517-8183-530e88335e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.912546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bcbe1-5fe9-4517-8183-530e88335e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.913257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bcbe1-5fe9-4517-8183-530e88335e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:11.913564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bcbe1-5fe9-4517-8183-530e88335e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.915833 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bcbe1-5fe9-4517-8183-530e88335e4c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.927135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1025/2037] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:14:11.931377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bcbe1-5fe9-4517-8183-530e88335e4c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.934640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1013/2038] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:11 2022] PUT /identity/v3/projects/542bb8e17ee44f5a9fae0eb76e1068ef/users/7913a7c737e643d397ffbfff5e65a89a/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:11.941045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bcbe1-5fe9-4517-8183-530e88335e4c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.945595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916742-210c-4f6b-988e-1ab112d92885 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.945953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916742-210c-4f6b-988e-1ab112d92885 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.946302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916742-210c-4f6b-988e-1ab112d92885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.952405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:11.976103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3a916742-210c-4f6b-988e-1ab112d92885 None None] MFA Rules not processed for user `7913a7c737e643d397ffbfff5e65a89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:11.977276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a916742-210c-4f6b-988e-1ab112d92885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:12.006301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343a9b6-0a3a-4513-8182-601e16d20a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.006944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a9b6-0a3a-4513-8182-601e16d20a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.007288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a9b6-0a3a-4513-8182-601e16d20a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.007567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a9b6-0a3a-4513-8182-601e16d20a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.008255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343a9b6-0a3a-4513-8182-601e16d20a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.010175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343a9b6-0a3a-4513-8182-601e16d20a9a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.042520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1014/2039] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:12.044021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916742-210c-4f6b-988e-1ab112d92885 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.045351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a916742-210c-4f6b-988e-1ab112d92885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:12.102252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1026/2040] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:11 2022] POST /identity/v3/projects => generated 359 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:12.102423 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916742-210c-4f6b-988e-1ab112d92885 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.102522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343a9b6-0a3a-4513-8182-601e16d20a9a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.148260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f291b-2a24-4b54-ac16-4cd2fb29b8ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.148919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f291b-2a24-4b54-ac16-4cd2fb29b8ae service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.149202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f291b-2a24-4b54-ac16-4cd2fb29b8ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.149483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f291b-2a24-4b54-ac16-4cd2fb29b8ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.151795 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-597f291b-2a24-4b54-ac16-4cd2fb29b8ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:12.162441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:12.164881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343a9b6-0a3a-4513-8182-601e16d20a9a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.170227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9510a2-86c9-4f5e-84ff-46786b07f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.170880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9510a2-86c9-4f5e-84ff-46786b07f693 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.177495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9510a2-86c9-4f5e-84ff-46786b07f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.177495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9510a2-86c9-4f5e-84ff-46786b07f693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.177495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9510a2-86c9-4f5e-84ff-46786b07f693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.177495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9510a2-86c9-4f5e-84ff-46786b07f693 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.212717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f291b-2a24-4b54-ac16-4cd2fb29b8ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.214172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f291b-2a24-4b54-ac16-4cd2fb29b8ae service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.223065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1015/2041] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:12.223936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f291b-2a24-4b54-ac16-4cd2fb29b8ae service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.234923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f291b-2a24-4b54-ac16-4cd2fb29b8ae service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.239122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5948245-32fb-4b87-ab83-191b59706273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.239808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5948245-32fb-4b87-ab83-191b59706273 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.240094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5948245-32fb-4b87-ab83-191b59706273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.240372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5948245-32fb-4b87-ab83-191b59706273 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.241071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5948245-32fb-4b87-ab83-191b59706273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.242986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5948245-32fb-4b87-ab83-191b59706273 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.263362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1027/2042] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:12.267878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9510a2-86c9-4f5e-84ff-46786b07f693 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.320720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:12.333017 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9510a2-86c9-4f5e-84ff-46786b07f693 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.338317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486006c-4c51-40ef-a85b-0ca98c14288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.338984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486006c-4c51-40ef-a85b-0ca98c14288a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.339303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486006c-4c51-40ef-a85b-0ca98c14288a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.339574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486006c-4c51-40ef-a85b-0ca98c14288a admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.340256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486006c-4c51-40ef-a85b-0ca98c14288a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.342143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486006c-4c51-40ef-a85b-0ca98c14288a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.363772 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1016/2043] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/users => generated 280 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:12.363772 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5948245-32fb-4b87-ab83-191b59706273 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.371314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5948245-32fb-4b87-ab83-191b59706273 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.375931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0663800-94aa-4ae7-a7a8-52c80db1104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.376570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0663800-94aa-4ae7-a7a8-52c80db1104b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.376857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0663800-94aa-4ae7-a7a8-52c80db1104b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.377134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0663800-94aa-4ae7-a7a8-52c80db1104b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.377870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0663800-94aa-4ae7-a7a8-52c80db1104b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.379485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0663800-94aa-4ae7-a7a8-52c80db1104b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.383081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:12.391750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1017/2044] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:12.395404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0663800-94aa-4ae7-a7a8-52c80db1104b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.405454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0663800-94aa-4ae7-a7a8-52c80db1104b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.410009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2eec8-55b6-4073-932b-05f5701af605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.410623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2eec8-55b6-4073-932b-05f5701af605 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.410904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2eec8-55b6-4073-932b-05f5701af605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.411212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2eec8-55b6-4073-932b-05f5701af605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.411911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2eec8-55b6-4073-932b-05f5701af605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.413451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2eec8-55b6-4073-932b-05f5701af605 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.423641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1018/2045] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:12.429758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2eec8-55b6-4073-932b-05f5701af605 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.438771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2eec8-55b6-4073-932b-05f5701af605 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.443351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a71f6-c5ae-4185-af5e-f344efedc306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.444188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a71f6-c5ae-4185-af5e-f344efedc306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.444483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a71f6-c5ae-4185-af5e-f344efedc306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.444755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a71f6-c5ae-4185-af5e-f344efedc306 admin admin] PATH_INFO: `/v3/projects/e94b456536fc4d029aabfc65c953ddff/users/abd92e0755c44475bbafbe6b2d62cbc7/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.455442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1028/2046] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:12.457833 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486006c-4c51-40ef-a85b-0ca98c14288a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.463687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a71f6-c5ae-4185-af5e-f344efedc306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94b456536fc4d029aabfc65c953ddff, user_id=abd92e0755c44475bbafbe6b2d62cbc7, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.466466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a71f6-c5ae-4185-af5e-f344efedc306 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.469243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486006c-4c51-40ef-a85b-0ca98c14288a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.473992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdd895-b466-4715-a289-f0aad2f042cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.474640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdd895-b466-4715-a289-f0aad2f042cd admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.474919 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdd895-b466-4715-a289-f0aad2f042cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.475228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdd895-b466-4715-a289-f0aad2f042cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.475943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdd895-b466-4715-a289-f0aad2f042cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.477524 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdd895-b466-4715-a289-f0aad2f042cd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.488881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1029/2047] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:12.492696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdd895-b466-4715-a289-f0aad2f042cd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.501979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdd895-b466-4715-a289-f0aad2f042cd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.506461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d425f70-f871-43a7-bf50-380f7c9b9ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.507443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d425f70-f871-43a7-bf50-380f7c9b9ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.507443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d425f70-f871-43a7-bf50-380f7c9b9ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.507620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d425f70-f871-43a7-bf50-380f7c9b9ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.508280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d425f70-f871-43a7-bf50-380f7c9b9ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.510278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d425f70-f871-43a7-bf50-380f7c9b9ac9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.519446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1030/2048] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:12.522940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d425f70-f871-43a7-bf50-380f7c9b9ac9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.532483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d425f70-f871-43a7-bf50-380f7c9b9ac9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.536954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f0028-1722-4608-ab4f-6fb5eab23faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.537764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0028-1722-4608-ab4f-6fb5eab23faf admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.538039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0028-1722-4608-ab4f-6fb5eab23faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.538301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0028-1722-4608-ab4f-6fb5eab23faf admin admin] PATH_INFO: `/v3/projects/efebc2cc1524488eb180a51fa74070d2/users/047833afb34d46879b2a86be92fdc1e8/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.553502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f0028-1722-4608-ab4f-6fb5eab23faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=efebc2cc1524488eb180a51fa74070d2, user_id=047833afb34d46879b2a86be92fdc1e8, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.555737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1019/2049] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:12 2022] PUT /identity/v3/projects/e94b456536fc4d029aabfc65c953ddff/users/abd92e0755c44475bbafbe6b2d62cbc7/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:12.565033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f0028-1722-4608-ab4f-6fb5eab23faf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.566258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc190dfb-4a68-474d-9bad-1428cfb59de5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.566656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc190dfb-4a68-474d-9bad-1428cfb59de5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.567037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc190dfb-4a68-474d-9bad-1428cfb59de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.597055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bc190dfb-4a68-474d-9bad-1428cfb59de5 None None] MFA Rules not processed for user `abd92e0755c44475bbafbe6b2d62cbc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:12.598403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bc190dfb-4a68-474d-9bad-1428cfb59de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:12.630135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1031/2050] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:12 2022] PUT /identity/v3/projects/efebc2cc1524488eb180a51fa74070d2/users/047833afb34d46879b2a86be92fdc1e8/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:12.641135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1dec8-d697-4170-9eb0-dc7f1dfd1b52 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.641547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1dec8-d697-4170-9eb0-dc7f1dfd1b52 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.641898 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1dec8-d697-4170-9eb0-dc7f1dfd1b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.666036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1020/2051] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:12.684928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4bb1dec8-d697-4170-9eb0-dc7f1dfd1b52 None None] MFA Rules not processed for user `047833afb34d46879b2a86be92fdc1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:12.686095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4bb1dec8-d697-4170-9eb0-dc7f1dfd1b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:12.704277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc190dfb-4a68-474d-9bad-1428cfb59de5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.710849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bc190dfb-4a68-474d-9bad-1428cfb59de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:12.761658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1032/2052] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:12.766026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1dec8-d697-4170-9eb0-dc7f1dfd1b52 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.766956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc190dfb-4a68-474d-9bad-1428cfb59de5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.788948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:12.818224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406825-611c-4b25-90d0-9975c3055ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.818873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406825-611c-4b25-90d0-9975c3055ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.819188 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406825-611c-4b25-90d0-9975c3055ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.819468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406825-611c-4b25-90d0-9975c3055ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.827399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1dec8-d697-4170-9eb0-dc7f1dfd1b52 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.832160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a0419-1fa6-4dad-bd9b-ec56dc770dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.839625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a0419-1fa6-4dad-bd9b-ec56dc770dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.839625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a0419-1fa6-4dad-bd9b-ec56dc770dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.839625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a0419-1fa6-4dad-bd9b-ec56dc770dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.839625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a0419-1fa6-4dad-bd9b-ec56dc770dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.839625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a0419-1fa6-4dad-bd9b-ec56dc770dc3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.876263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef406825-611c-4b25-90d0-9975c3055ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.877653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef406825-611c-4b25-90d0-9975c3055ca7 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.888743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1021/2053] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:12.904093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406825-611c-4b25-90d0-9975c3055ca7 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.916454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406825-611c-4b25-90d0-9975c3055ca7 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.922000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.922952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.923322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.923609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] PATH_INFO: `/v3/users/abd92e0755c44475bbafbe6b2d62cbc7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.924961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd92e0755c44475bbafbe6b2d62cbc7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.935005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.975675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1033/2054] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:12.982318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a0419-1fa6-4dad-bd9b-ec56dc770dc3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.997021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:13.046915 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a0419-1fa6-4dad-bd9b-ec56dc770dc3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.052101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea12c1-d075-4582-8d64-115264160df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.052797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea12c1-d075-4582-8d64-115264160df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.053068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea12c1-d075-4582-8d64-115264160df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.053330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea12c1-d075-4582-8d64-115264160df9 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.054015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea12c1-d075-4582-8d64-115264160df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.056588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea12c1-d075-4582-8d64-115264160df9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.134074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd92e0755c44475bbafbe6b2d62cbc7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:13.134654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd92e0755c44475bbafbe6b2d62cbc7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:13.144601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1034/2055] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:13.147815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd92e0755c44475bbafbe6b2d62cbc7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:13.148459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea12c1-d075-4582-8d64-115264160df9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.150505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-23ea12c1-d075-4582-8d64-115264160df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.155038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd92e0755c44475bbafbe6b2d62cbc7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:13.155750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3f4a92d6-b192-4cda-832b-af91f2f3b39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd92e0755c44475bbafbe6b2d62cbc7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:13.163539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea12c1-d075-4582-8d64-115264160df9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.168773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62f2f-76c4-453f-9b2f-0315db029d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.169463 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62f2f-76c4-453f-9b2f-0315db029d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.169744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62f2f-76c4-453f-9b2f-0315db029d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.170016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62f2f-76c4-453f-9b2f-0315db029d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.171271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c62f2f-76c4-453f-9b2f-0315db029d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.172397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c62f2f-76c4-453f-9b2f-0315db029d1a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.183383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1035/2056] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:13.187124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62f2f-76c4-453f-9b2f-0315db029d1a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.196377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62f2f-76c4-453f-9b2f-0315db029d1a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.201019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8ac0b-e8be-4fe0-94b9-891254bd998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.201844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8ac0b-e8be-4fe0-94b9-891254bd998f admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.202122 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8ac0b-e8be-4fe0-94b9-891254bd998f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.202396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8ac0b-e8be-4fe0-94b9-891254bd998f admin admin] PATH_INFO: `/v3/projects/db56a229a5a6408883a58eceef3dcb8e/users/a4f78c651d4b47cb86b6809edeee784e/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.217225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8ac0b-e8be-4fe0-94b9-891254bd998f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db56a229a5a6408883a58eceef3dcb8e, user_id=a4f78c651d4b47cb86b6809edeee784e, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.219879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8ac0b-e8be-4fe0-94b9-891254bd998f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.220175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1022/2057] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:12 2022] DELETE /identity/v3/users/abd92e0755c44475bbafbe6b2d62cbc7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:13.225033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c429cc2-6bbe-4f43-9007-f21edcdac1ba None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.225322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c429cc2-6bbe-4f43-9007-f21edcdac1ba None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.225600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c429cc2-6bbe-4f43-9007-f21edcdac1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.242680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5c429cc2-6bbe-4f43-9007-f21edcdac1ba None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:13.244456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5c429cc2-6bbe-4f43-9007-f21edcdac1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.263696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:13.302754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1023/2058] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:13.312801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c429cc2-6bbe-4f43-9007-f21edcdac1ba None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.314100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5c429cc2-6bbe-4f43-9007-f21edcdac1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.332852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1036/2059] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:13 2022] PUT /identity/v3/projects/db56a229a5a6408883a58eceef3dcb8e/users/a4f78c651d4b47cb86b6809edeee784e/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:13.340423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8ac0b-e8be-4fe0-94b9-891254bd998f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.371036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c429cc2-6bbe-4f43-9007-f21edcdac1ba None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.404697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8ac0b-e8be-4fe0-94b9-891254bd998f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.409356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd11cd-2c7c-4697-855b-629357113a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.410052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd11cd-2c7c-4697-855b-629357113a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.410451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd11cd-2c7c-4697-855b-629357113a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.410735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd11cd-2c7c-4697-855b-629357113a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.411491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd11cd-2c7c-4697-855b-629357113a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.413111 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd11cd-2c7c-4697-855b-629357113a1c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.420818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ac651-df8b-4738-b233-2519c9ce5c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.423822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ac651-df8b-4738-b233-2519c9ce5c86 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.423822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ac651-df8b-4738-b233-2519c9ce5c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.423822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ac651-df8b-4738-b233-2519c9ce5c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.424064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1037/2060] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:13.428063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd11cd-2c7c-4697-855b-629357113a1c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.434714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ac651-df8b-4738-b233-2519c9ce5c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.436172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ac651-df8b-4738-b233-2519c9ce5c86 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.437616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd11cd-2c7c-4697-855b-629357113a1c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.442732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877684-3247-44cc-9092-8e2199871e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.443629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877684-3247-44cc-9092-8e2199871e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.443946 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877684-3247-44cc-9092-8e2199871e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.444225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877684-3247-44cc-9092-8e2199871e74 admin admin] PATH_INFO: `/v3/projects/db56a229a5a6408883a58eceef3dcb8e/users/a4f78c651d4b47cb86b6809edeee784e/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.446245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1024/2061] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:13.446375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52877684-3247-44cc-9092-8e2199871e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db56a229a5a6408883a58eceef3dcb8e, user_id=a4f78c651d4b47cb86b6809edeee784e, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.449377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52877684-3247-44cc-9092-8e2199871e74 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.459896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1038/2062] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:13 2022] PUT /identity/v3/projects/db56a229a5a6408883a58eceef3dcb8e/users/a4f78c651d4b47cb86b6809edeee784e/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:13.471348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c3690-e094-4c2b-a7f0-3d98e949ee2c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.471638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c3690-e094-4c2b-a7f0-3d98e949ee2c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.471916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c3690-e094-4c2b-a7f0-3d98e949ee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.498962 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-017c3690-e094-4c2b-a7f0-3d98e949ee2c None None] MFA Rules not processed for user `a4f78c651d4b47cb86b6809edeee784e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:13.500294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-017c3690-e094-4c2b-a7f0-3d98e949ee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.568220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1025/2063] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:13.579306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877684-3247-44cc-9092-8e2199871e74 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.581025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-52877684-3247-44cc-9092-8e2199871e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.635236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:13.638955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877684-3247-44cc-9092-8e2199871e74 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.642608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029b0c0-485c-46a6-bc93-1cece35831e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.643278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029b0c0-485c-46a6-bc93-1cece35831e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.643558 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029b0c0-485c-46a6-bc93-1cece35831e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.644226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029b0c0-485c-46a6-bc93-1cece35831e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.645690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c029b0c0-485c-46a6-bc93-1cece35831e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.711433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029b0c0-485c-46a6-bc93-1cece35831e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.713405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029b0c0-485c-46a6-bc93-1cece35831e4 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.722547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1039/2064] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:13.898413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c3690-e094-4c2b-a7f0-3d98e949ee2c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.900617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-017c3690-e094-4c2b-a7f0-3d98e949ee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.913235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:13.971335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c3690-e094-4c2b-a7f0-3d98e949ee2c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.984776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.985660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.985937 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.986233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] PATH_INFO: `/v3/projects/e94b456536fc4d029aabfc65c953ddff` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.987473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94b456536fc4d029aabfc65c953ddff)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.990012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:14.090759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94b456536fc4d029aabfc65c953ddff', 'request_id': 'req-97ba8656-a67c-4efb-827f-25850fd2af31'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:14.097093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94b456536fc4d029aabfc65c953ddff', 'request_id': 'req-97ba8656-a67c-4efb-827f-25850fd2af31'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:14.185517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94b456536fc4d029aabfc65c953ddff', 'request_id': 'req-97ba8656-a67c-4efb-827f-25850fd2af31'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:14.197220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] The token cache is being invalidate because project e94b456536fc4d029aabfc65c953ddff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:14.197513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:14.198651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:14.199737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1026/2065] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:13 2022] DELETE /identity/v3/projects/e94b456536fc4d029aabfc65c953ddff => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:16.955518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029b0c0-485c-46a6-bc93-1cece35831e4 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:16.964050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029b0c0-485c-46a6-bc93-1cece35831e4 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:17.013367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:17.014016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:17.014337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:17.014604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:17.016583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:17.082619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:17.084180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:17.094698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1040/2066] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:18.734244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:18.735775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:18.748376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba8656-a67c-4efb-827f-25850fd2af31 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:18.752144 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d26a7a-5942-41d3-b3cd-b4fbd199313e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:18.752854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d26a7a-5942-41d3-b3cd-b4fbd199313e service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:18.753204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d26a7a-5942-41d3-b3cd-b4fbd199313e service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:18.753546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d26a7a-5942-41d3-b3cd-b4fbd199313e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:18.755393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-47d26a7a-5942-41d3-b3cd-b4fbd199313e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:18.817468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d26a7a-5942-41d3-b3cd-b4fbd199313e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:18.818901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d26a7a-5942-41d3-b3cd-b4fbd199313e service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:18.833077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1027/2067] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:19.391662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:19.393215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:19.458964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:19.465439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56999f-2036-497c-8a2a-beecb12ea421 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:19.470419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:19.471345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:19.471611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:19.471909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] PATH_INFO: `/v3/users/47d68f62b562431a9afadcb47e980cd9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:19.473128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d68f62b562431a9afadcb47e980cd9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:19.475138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:19.699156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d68f62b562431a9afadcb47e980cd9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:19.699854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d68f62b562431a9afadcb47e980cd9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:19.706669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d68f62b562431a9afadcb47e980cd9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:19.721894 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d68f62b562431a9afadcb47e980cd9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:19.733778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d68f62b562431a9afadcb47e980cd9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:19.816692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1041/2068] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:19 2022] DELETE /identity/v3/users/47d68f62b562431a9afadcb47e980cd9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:19.821390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724cc0f-2085-4c21-aed5-7cc6a24c1770 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:19.821848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724cc0f-2085-4c21-aed5-7cc6a24c1770 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:19.821964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724cc0f-2085-4c21-aed5-7cc6a24c1770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:19.847473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c724cc0f-2085-4c21-aed5-7cc6a24c1770 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:19.848664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c724cc0f-2085-4c21-aed5-7cc6a24c1770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:19.878649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:19.907775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1028/2069] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:19.920255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:19.921999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:19.980208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa382637-b2f4-42b7-a7b9-71e35990e087 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:19.984902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65672d-26df-44ee-8fc1-fda37672be17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:19.985548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65672d-26df-44ee-8fc1-fda37672be17 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:19.985831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65672d-26df-44ee-8fc1-fda37672be17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:19.986187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65672d-26df-44ee-8fc1-fda37672be17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:19.996439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65672d-26df-44ee-8fc1-fda37672be17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:20.002340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65672d-26df-44ee-8fc1-fda37672be17 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:20.010034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1042/2070] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:20.392017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724cc0f-2085-4c21-aed5-7cc6a24c1770 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:20.393574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c724cc0f-2085-4c21-aed5-7cc6a24c1770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:20.406340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724cc0f-2085-4c21-aed5-7cc6a24c1770 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:20.410976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:20.411875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:20.412160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:20.412435 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] PATH_INFO: `/v3/users/8675fba9ab304b7cb1b56857b96ad533` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:20.413619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8675fba9ab304b7cb1b56857b96ad533)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:20.415646 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:20.538399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65672d-26df-44ee-8fc1-fda37672be17 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:20.538399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4b65672d-26df-44ee-8fc1-fda37672be17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:20.550437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65672d-26df-44ee-8fc1-fda37672be17 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:20.555165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:20.560047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:20.560431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:20.560674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] PATH_INFO: `/v3/projects/9577f74cfd16471fb9430a348ee2abe1` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:20.562050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9577f74cfd16471fb9430a348ee2abe1)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:20.563993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:20.653093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8675fba9ab304b7cb1b56857b96ad533'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.653731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8675fba9ab304b7cb1b56857b96ad533'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.666328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8675fba9ab304b7cb1b56857b96ad533'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.673271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8675fba9ab304b7cb1b56857b96ad533'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.673954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4426fe51-6047-493a-9ba9-e507fa6654ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8675fba9ab304b7cb1b56857b96ad533'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.680586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9577f74cfd16471fb9430a348ee2abe1', 'request_id': 'req-a02ab599-7d01-4f4c-ad76-7bbf416c2054'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.686716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9577f74cfd16471fb9430a348ee2abe1', 'request_id': 'req-a02ab599-7d01-4f4c-ad76-7bbf416c2054'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.766273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1029/2071] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:20 2022] DELETE /identity/v3/users/8675fba9ab304b7cb1b56857b96ad533 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:20.770797 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681dfc8-b07f-4ac8-a3a0-eabbc059b749 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:20.771084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681dfc8-b07f-4ac8-a3a0-eabbc059b749 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:20.771390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681dfc8-b07f-4ac8-a3a0-eabbc059b749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:20.788402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9681dfc8-b07f-4ac8-a3a0-eabbc059b749 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:20.789542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9681dfc8-b07f-4ac8-a3a0-eabbc059b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:20.854306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1030/2072] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:20.863736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9577f74cfd16471fb9430a348ee2abe1', 'request_id': 'req-a02ab599-7d01-4f4c-ad76-7bbf416c2054'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.866482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681dfc8-b07f-4ac8-a3a0-eabbc059b749 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:20.872347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9681dfc8-b07f-4ac8-a3a0-eabbc059b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:20.883857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] The token cache is being invalidate because project 9577f74cfd16471fb9430a348ee2abe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:20.884251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.885117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:20.888537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1043/2073] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:20 2022] DELETE /identity/v3/projects/9577f74cfd16471fb9430a348ee2abe1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:20.892132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:20.899019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:20.906066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:20.948361 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681dfc8-b07f-4ac8-a3a0-eabbc059b749 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:20.952752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:20.953417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:20.953936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:20.954456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:20.956930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:20.970309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:20.972314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:20.983746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1031/2074] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:20.993176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ab599-7d01-4f4c-ad76-7bbf416c2054 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:20.999511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:21.000618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:21.001967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:21.001967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] PATH_INFO: `/v3/users/50e541707b4a4d9aa6c392fd93c2f872` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:21.002721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e541707b4a4d9aa6c392fd93c2f872)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:21.007141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:21.018831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:21.208782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e541707b4a4d9aa6c392fd93c2f872'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:21.209716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e541707b4a4d9aa6c392fd93c2f872'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:21.210648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e541707b4a4d9aa6c392fd93c2f872'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:21.224837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e541707b4a4d9aa6c392fd93c2f872'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:21.244106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e541707b4a4d9aa6c392fd93c2f872'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:21.368794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1044/2075] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:20 2022] DELETE /identity/v3/users/50e541707b4a4d9aa6c392fd93c2f872 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:21.690876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:21.696809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:21.710625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08049e01-474d-404e-add9-f3cbe376dcb6 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:21.803318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:21.804255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:21.806159 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:21.806159 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] PATH_INFO: `/v3/projects/a69404f7ed1a4a0ab8f5b3b28063d6d3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:21.806377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69404f7ed1a4a0ab8f5b3b28063d6d3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:21.808354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:21.983409 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:21.986058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:22.004837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308ca4b-8471-4c4f-92e7-1fc6bfac0477 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:22.006768 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69404f7ed1a4a0ab8f5b3b28063d6d3', 'request_id': 'req-e2da0c8e-d095-44b8-991e-3e238d549ad2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.019702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69404f7ed1a4a0ab8f5b3b28063d6d3', 'request_id': 'req-e2da0c8e-d095-44b8-991e-3e238d549ad2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.067980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:22.068850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.069132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.069412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] PATH_INFO: `/v3/projects/d871f345cb3b47ebbecf49bc9322298f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.070578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d871f345cb3b47ebbecf49bc9322298f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:22.072591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:22.122477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69404f7ed1a4a0ab8f5b3b28063d6d3', 'request_id': 'req-e2da0c8e-d095-44b8-991e-3e238d549ad2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.133718 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] The token cache is being invalidate because project a69404f7ed1a4a0ab8f5b3b28063d6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:22.134063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.134933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.136679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1032/2076] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:21 2022] DELETE /identity/v3/projects/a69404f7ed1a4a0ab8f5b3b28063d6d3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:22.140703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:22.142042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:22.154843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da0c8e-d095-44b8-991e-3e238d549ad2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:22.159864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:22.160754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.161156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.161331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] PATH_INFO: `/v3/users/06e7d696fe3843ef867900658ca608e6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.162550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e7d696fe3843ef867900658ca608e6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:22.164513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:22.220531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd871f345cb3b47ebbecf49bc9322298f', 'request_id': 'req-d8c16137-3970-4637-8427-a4bc209cc3d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.226805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd871f345cb3b47ebbecf49bc9322298f', 'request_id': 'req-d8c16137-3970-4637-8427-a4bc209cc3d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.325720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd871f345cb3b47ebbecf49bc9322298f', 'request_id': 'req-d8c16137-3970-4637-8427-a4bc209cc3d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.337281 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] The token cache is being invalidate because project d871f345cb3b47ebbecf49bc9322298f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:22.337570 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.338207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d8c16137-3970-4637-8427-a4bc209cc3d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.342402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1045/2077] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:21 2022] DELETE /identity/v3/projects/d871f345cb3b47ebbecf49bc9322298f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:22.347540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc115a4-09b3-4b87-9beb-6c68fe3608a2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.347925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc115a4-09b3-4b87-9beb-6c68fe3608a2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.348201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc115a4-09b3-4b87-9beb-6c68fe3608a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.373842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-9dc115a4-09b3-4b87-9beb-6c68fe3608a2 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:22.375150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9dc115a4-09b3-4b87-9beb-6c68fe3608a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:22.383819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e7d696fe3843ef867900658ca608e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.384716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e7d696fe3843ef867900658ca608e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.418974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e7d696fe3843ef867900658ca608e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.447018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e7d696fe3843ef867900658ca608e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.447927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e7d696fe3843ef867900658ca608e6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:22.453018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1046/2078] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:22.460404 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:22.462025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb9cd-ba9e-43af-89e7-6d72060014ee None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.462358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb9cd-ba9e-43af-89e7-6d72060014ee None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.462632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb9cd-ba9e-43af-89e7-6d72060014ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.481136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-68dbb9cd-ba9e-43af-89e7-6d72060014ee None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:22.482322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-68dbb9cd-ba9e-43af-89e7-6d72060014ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:22.490509 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1047/2079] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:22.494348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbb9cd-ba9e-43af-89e7-6d72060014ee None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:22.503226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbb9cd-ba9e-43af-89e7-6d72060014ee None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:22.507882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6947c0f-ae6f-477e-82c5-41b335b10274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:22.508496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6947c0f-ae6f-477e-82c5-41b335b10274 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.508779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6947c0f-ae6f-477e-82c5-41b335b10274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.509052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6947c0f-ae6f-477e-82c5-41b335b10274 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.509763 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6947c0f-ae6f-477e-82c5-41b335b10274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:22.510071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6947c0f-ae6f-477e-82c5-41b335b10274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:22.511703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6947c0f-ae6f-477e-82c5-41b335b10274 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:22.522827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1048/2080] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:14:22.527251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6947c0f-ae6f-477e-82c5-41b335b10274 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:22.536684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6947c0f-ae6f-477e-82c5-41b335b10274 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:22.541564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cabdb-e5ec-4bba-bba7-beba0dcafde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:22.542705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cabdb-e5ec-4bba-bba7-beba0dcafde6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.542987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cabdb-e5ec-4bba-bba7-beba0dcafde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.543293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cabdb-e5ec-4bba-bba7-beba0dcafde6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.543976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cabdb-e5ec-4bba-bba7-beba0dcafde6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:22.545865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cabdb-e5ec-4bba-bba7-beba0dcafde6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:22.547310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1033/2081] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:22 2022] DELETE /identity/v3/users/06e7d696fe3843ef867900658ca608e6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:22.635115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:22.642818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1049/2082] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:22 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:22.646795 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:22.709626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a9f68-1920-4bc8-98eb-0a191c9ae46e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:22.767686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db281c-da7d-4fa4-9e6e-319931ef9256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:22.768392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db281c-da7d-4fa4-9e6e-319931ef9256 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.768678 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db281c-da7d-4fa4-9e6e-319931ef9256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.768961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db281c-da7d-4fa4-9e6e-319931ef9256 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.769697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db281c-da7d-4fa4-9e6e-319931ef9256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:22.771754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db281c-da7d-4fa4-9e6e-319931ef9256 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:22.878648 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1034/2083] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:22 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:22.882533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cabdb-e5ec-4bba-bba7-beba0dcafde6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:22.894755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cabdb-e5ec-4bba-bba7-beba0dcafde6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:22.900398 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba70c40-54b3-4347-8ab1-ef9ca2633df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:22.905700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70c40-54b3-4347-8ab1-ef9ca2633df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.905700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70c40-54b3-4347-8ab1-ef9ca2633df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.905700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70c40-54b3-4347-8ab1-ef9ca2633df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.905700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba70c40-54b3-4347-8ab1-ef9ca2633df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:22.905700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba70c40-54b3-4347-8ab1-ef9ca2633df2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:22.917023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1050/2084] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:22.920843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db281c-da7d-4fa4-9e6e-319931ef9256 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:22.931377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db281c-da7d-4fa4-9e6e-319931ef9256 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:22.936364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d6cb7-f790-493e-9b55-a7b682bc708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:22.937106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d6cb7-f790-493e-9b55-a7b682bc708c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.937360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d6cb7-f790-493e-9b55-a7b682bc708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.937645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d6cb7-f790-493e-9b55-a7b682bc708c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.938394 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d6cb7-f790-493e-9b55-a7b682bc708c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:22.940156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d6cb7-f790-493e-9b55-a7b682bc708c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:22.951231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1035/2085] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:22.957506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba70c40-54b3-4347-8ab1-ef9ca2633df2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:22.968196 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba70c40-54b3-4347-8ab1-ef9ca2633df2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:22.972640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a412bd-9ad3-4a7c-95e7-c6a0cd679195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:22.974817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a412bd-9ad3-4a7c-95e7-c6a0cd679195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:22.975119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a412bd-9ad3-4a7c-95e7-c6a0cd679195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:22.975401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a412bd-9ad3-4a7c-95e7-c6a0cd679195 admin admin] PATH_INFO: `/v3/projects/bbfcbbbc08554a2cab083edefb1c1ec6/users/c4c309516d49427bb679901ee30ba9c7/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:22.990333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a412bd-9ad3-4a7c-95e7-c6a0cd679195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfcbbbc08554a2cab083edefb1c1ec6, user_id=c4c309516d49427bb679901ee30ba9c7, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:22.993003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a412bd-9ad3-4a7c-95e7-c6a0cd679195 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:23.012422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d6cb7-f790-493e-9b55-a7b682bc708c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:23.013472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5f5d6cb7-f790-493e-9b55-a7b682bc708c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:23.031656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d6cb7-f790-493e-9b55-a7b682bc708c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:23.037694 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:23.038593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.038899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.039222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] PATH_INFO: `/v3/projects/2bc154b67abf46f5a267afbcd2ff4817` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.040403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc154b67abf46f5a267afbcd2ff4817)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:23.042452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:23.166076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1051/2086] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:22 2022] PUT /identity/v3/projects/bbfcbbbc08554a2cab083edefb1c1ec6/users/c4c309516d49427bb679901ee30ba9c7/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:23.170459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd22be-bb61-4004-bf68-891ceaebdd79 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.170766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd22be-bb61-4004-bf68-891ceaebdd79 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.171050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd22be-bb61-4004-bf68-891ceaebdd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.199535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-84dd22be-bb61-4004-bf68-891ceaebdd79 None None] MFA Rules not processed for user `c4c309516d49427bb679901ee30ba9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:23.200748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-84dd22be-bb61-4004-bf68-891ceaebdd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:23.220250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc154b67abf46f5a267afbcd2ff4817', 'request_id': 'req-9d194484-6fb7-44db-9cae-9dee15edda9f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:23.231164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc154b67abf46f5a267afbcd2ff4817', 'request_id': 'req-9d194484-6fb7-44db-9cae-9dee15edda9f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:23.286739 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1052/2087] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:23.302048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd22be-bb61-4004-bf68-891ceaebdd79 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:23.326535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc154b67abf46f5a267afbcd2ff4817', 'request_id': 'req-9d194484-6fb7-44db-9cae-9dee15edda9f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:23.341758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] The token cache is being invalidate because project 2bc154b67abf46f5a267afbcd2ff4817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:23.342115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:23.344760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9d194484-6fb7-44db-9cae-9dee15edda9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:23.346310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1036/2088] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:23 2022] DELETE /identity/v3/projects/2bc154b67abf46f5a267afbcd2ff4817 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:23.351548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ed6e-27e8-49f9-9fb5-e76d0f3f6f85 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.352014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ed6e-27e8-49f9-9fb5-e76d0f3f6f85 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.352359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ed6e-27e8-49f9-9fb5-e76d0f3f6f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.372845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ddb7ed6e-27e8-49f9-9fb5-e76d0f3f6f85 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:23.374067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ddb7ed6e-27e8-49f9-9fb5-e76d0f3f6f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:23.377715 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd22be-bb61-4004-bf68-891ceaebdd79 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:23.433635 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feab5f-01c4-4e91-8982-43d3fd46eb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:23.434440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1037/2089] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:23.434561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feab5f-01c4-4e91-8982-43d3fd46eb0a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.434762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feab5f-01c4-4e91-8982-43d3fd46eb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.435177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feab5f-01c4-4e91-8982-43d3fd46eb0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.435934 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feab5f-01c4-4e91-8982-43d3fd46eb0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:23.438188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feab5f-01c4-4e91-8982-43d3fd46eb0a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:23.441929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167026c-3c8d-4534-8b6c-aabeb14c3edc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.442222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167026c-3c8d-4534-8b6c-aabeb14c3edc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.442503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167026c-3c8d-4534-8b6c-aabeb14c3edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.504625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0167026c-3c8d-4534-8b6c-aabeb14c3edc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:23.506357 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0167026c-3c8d-4534-8b6c-aabeb14c3edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:23.516334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1038/2090] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:23.522753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167026c-3c8d-4534-8b6c-aabeb14c3edc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:23.537276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167026c-3c8d-4534-8b6c-aabeb14c3edc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:23.550691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38924cf0-cc52-4b25-af9b-9a24120ff1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:23.552182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38924cf0-cc52-4b25-af9b-9a24120ff1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.552473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38924cf0-cc52-4b25-af9b-9a24120ff1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.552750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38924cf0-cc52-4b25-af9b-9a24120ff1ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.553945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38924cf0-cc52-4b25-af9b-9a24120ff1ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:23.555175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38924cf0-cc52-4b25-af9b-9a24120ff1ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:23.556924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38924cf0-cc52-4b25-af9b-9a24120ff1ea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:23.572333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1039/2091] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:14:23.578262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38924cf0-cc52-4b25-af9b-9a24120ff1ea admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:23.594680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1053/2092] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:23 2022] POST /identity/v3/projects => generated 377 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:23.595521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38924cf0-cc52-4b25-af9b-9a24120ff1ea admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:23.598852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feab5f-01c4-4e91-8982-43d3fd46eb0a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:23.601084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-74feab5f-01c4-4e91-8982-43d3fd46eb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:23.644418 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:23.666987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763b043-150c-48e3-8f93-91652b3de036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:23.667700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763b043-150c-48e3-8f93-91652b3de036 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.667985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763b043-150c-48e3-8f93-91652b3de036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.669818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763b043-150c-48e3-8f93-91652b3de036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.670541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763b043-150c-48e3-8f93-91652b3de036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:23.672474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763b043-150c-48e3-8f93-91652b3de036 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:23.685105 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feab5f-01c4-4e91-8982-43d3fd46eb0a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:23.691277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=5,keystone:DELETE=8,keystone:SELECT=87 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:23.692030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386f688-d4e9-42dc-abd0-87c7b7bb3712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:23.692445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f688-d4e9-42dc-abd0-87c7b7bb3712 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.693137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f688-d4e9-42dc-abd0-87c7b7bb3712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.693137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f688-d4e9-42dc-abd0-87c7b7bb3712 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.693939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386f688-d4e9-42dc-abd0-87c7b7bb3712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:23.696300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386f688-d4e9-42dc-abd0-87c7b7bb3712 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:23.842372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1054/2093] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:23 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:23.842372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386f688-d4e9-42dc-abd0-87c7b7bb3712 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:23.842372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d386f688-d4e9-42dc-abd0-87c7b7bb3712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:23.843916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1040/2094] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:23 2022] POST /identity/v3/projects => generated 387 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:23.844817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763b043-150c-48e3-8f93-91652b3de036 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:23.854767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386f688-d4e9-42dc-abd0-87c7b7bb3712 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:23.917361 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763b043-150c-48e3-8f93-91652b3de036 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:23.917728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:23.918673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.918955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.919268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] PATH_INFO: `/v3/users/7913a7c737e643d397ffbfff5e65a89a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.920498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7913a7c737e643d397ffbfff5e65a89a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:23.922190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0223ab-f899-444f-838e-f57a2d0d5085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:23.922410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:23.922850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0223ab-f899-444f-838e-f57a2d0d5085 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.923185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0223ab-f899-444f-838e-f57a2d0d5085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.923465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0223ab-f899-444f-838e-f57a2d0d5085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.924321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0223ab-f899-444f-838e-f57a2d0d5085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:23.925903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0223ab-f899-444f-838e-f57a2d0d5085 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:23.936765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1041/2095] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:23.937836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0223ab-f899-444f-838e-f57a2d0d5085 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:23.947618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0223ab-f899-444f-838e-f57a2d0d5085 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:23.952531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c8d2d-5468-4da7-bcac-e9b7065fedcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:23.953122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8d2d-5468-4da7-bcac-e9b7065fedcd admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:23.953409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8d2d-5468-4da7-bcac-e9b7065fedcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:23.953832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8d2d-5468-4da7-bcac-e9b7065fedcd admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:23.954510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c8d2d-5468-4da7-bcac-e9b7065fedcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:23.956469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c8d2d-5468-4da7-bcac-e9b7065fedcd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.029032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1042/2096] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:23 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:24.029865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c8d2d-5468-4da7-bcac-e9b7065fedcd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:24.031481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-995c8d2d-5468-4da7-bcac-e9b7065fedcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:24.043919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c8d2d-5468-4da7-bcac-e9b7065fedcd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:24.048641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:24.050437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.050437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.050437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] PATH_INFO: `/v3/users/aea254e4bdc142b9ae1767335fd84d61` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.051433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea254e4bdc142b9ae1767335fd84d61)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:24.053515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.081613 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7913a7c737e643d397ffbfff5e65a89a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.082277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7913a7c737e643d397ffbfff5e65a89a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.082893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7913a7c737e643d397ffbfff5e65a89a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.095046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7913a7c737e643d397ffbfff5e65a89a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.102096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7913a7c737e643d397ffbfff5e65a89a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.220581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1055/2097] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:23 2022] DELETE /identity/v3/users/7913a7c737e643d397ffbfff5e65a89a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:24.221364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:24.222690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:24.250684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea254e4bdc142b9ae1767335fd84d61'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.251408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea254e4bdc142b9ae1767335fd84d61'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.274832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea254e4bdc142b9ae1767335fd84d61'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.282653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea254e4bdc142b9ae1767335fd84d61'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.283577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea254e4bdc142b9ae1767335fd84d61'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:24.296863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c64ef-8628-4b79-9ab8-0bde4de36976 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:24.301529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4baf2d-7c89-414e-aa51-6b569e97e26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:24.302423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4baf2d-7c89-414e-aa51-6b569e97e26b admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.302708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4baf2d-7c89-414e-aa51-6b569e97e26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.302989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4baf2d-7c89-414e-aa51-6b569e97e26b admin admin] PATH_INFO: `/v3/projects/ea48e3de72e94d3e9f3a93d56db0904d/users/349c82d142254414af7702d036e69a45/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.317417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4baf2d-7c89-414e-aa51-6b569e97e26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea48e3de72e94d3e9f3a93d56db0904d, user_id=349c82d142254414af7702d036e69a45, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:24.320100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4baf2d-7c89-414e-aa51-6b569e97e26b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.408907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1043/2098] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:24 2022] DELETE /identity/v3/users/aea254e4bdc142b9ae1767335fd84d61 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:24.409762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:24.411197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:24.429485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1056/2099] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:24 2022] PUT /identity/v3/projects/ea48e3de72e94d3e9f3a93d56db0904d/users/349c82d142254414af7702d036e69a45/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:24.432160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5e66e-5ecc-42bd-8798-60dd6ed19437 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.432662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5e66e-5ecc-42bd-8798-60dd6ed19437 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.433139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5e66e-5ecc-42bd-8798-60dd6ed19437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.457451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f4d5e66e-5ecc-42bd-8798-60dd6ed19437 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:24.458847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f4d5e66e-5ecc-42bd-8798-60dd6ed19437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:24.485426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa3f80-f534-41f8-9c47-6eab55a1ad2d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:24.523738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1057/2100] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:24.528290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5e66e-5ecc-42bd-8798-60dd6ed19437 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:24.530035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f4d5e66e-5ecc-42bd-8798-60dd6ed19437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:24.543408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5e66e-5ecc-42bd-8798-60dd6ed19437 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:24.546606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21dbda-8277-42ee-8897-ec8f33107a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:24.547635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21dbda-8277-42ee-8897-ec8f33107a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.547982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21dbda-8277-42ee-8897-ec8f33107a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.548329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21dbda-8277-42ee-8897-ec8f33107a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.549132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21dbda-8277-42ee-8897-ec8f33107a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:24.550417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15535a9-3154-49b2-9d71-a8bd40fee3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:24.550763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21dbda-8277-42ee-8897-ec8f33107a28 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.551458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15535a9-3154-49b2-9d71-a8bd40fee3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.551886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15535a9-3154-49b2-9d71-a8bd40fee3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.553394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15535a9-3154-49b2-9d71-a8bd40fee3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.553394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15535a9-3154-49b2-9d71-a8bd40fee3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:24.554956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15535a9-3154-49b2-9d71-a8bd40fee3b1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.561515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1044/2101] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:24.565365 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21dbda-8277-42ee-8897-ec8f33107a28 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:24.566762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1058/2102] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:24.567045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8e21dbda-8277-42ee-8897-ec8f33107a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:24.567823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15535a9-3154-49b2-9d71-a8bd40fee3b1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:24.578891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15535a9-3154-49b2-9d71-a8bd40fee3b1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:24.584508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05d857-1c14-467e-946f-8f2c95ff0f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:24.585174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05d857-1c14-467e-946f-8f2c95ff0f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.585458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05d857-1c14-467e-946f-8f2c95ff0f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.585731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05d857-1c14-467e-946f-8f2c95ff0f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.586728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05d857-1c14-467e-946f-8f2c95ff0f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:24.588108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05d857-1c14-467e-946f-8f2c95ff0f4a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.599130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1059/2103] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:24.599130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05d857-1c14-467e-946f-8f2c95ff0f4a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:24.609489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05d857-1c14-467e-946f-8f2c95ff0f4a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:24.615008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cb4f1-0cb8-41d3-a7c1-5d683ed292e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:24.615925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cb4f1-0cb8-41d3-a7c1-5d683ed292e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.616200 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cb4f1-0cb8-41d3-a7c1-5d683ed292e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.616471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cb4f1-0cb8-41d3-a7c1-5d683ed292e4 admin admin] PATH_INFO: `/v3/projects/ea48e3de72e94d3e9f3a93d56db0904d/users/349c82d142254414af7702d036e69a45/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.618511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cb4f1-0cb8-41d3-a7c1-5d683ed292e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea48e3de72e94d3e9f3a93d56db0904d, user_id=349c82d142254414af7702d036e69a45, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:24.622009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cb4f1-0cb8-41d3-a7c1-5d683ed292e4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.631994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21dbda-8277-42ee-8897-ec8f33107a28 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:24.634325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1060/2104] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:24 2022] PUT /identity/v3/projects/ea48e3de72e94d3e9f3a93d56db0904d/users/349c82d142254414af7702d036e69a45/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:24.634863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cb4f1-0cb8-41d3-a7c1-5d683ed292e4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:24.695058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e35341-f948-4b8b-b029-e2abf77780ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:24.695058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e35341-f948-4b8b-b029-e2abf77780ef service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.695058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e35341-f948-4b8b-b029-e2abf77780ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.695058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e35341-f948-4b8b-b029-e2abf77780ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.707500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cb4f1-0cb8-41d3-a7c1-5d683ed292e4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:24.717244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c107e1-e58a-4ae6-9d61-beb97c48b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:24.718151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c107e1-e58a-4ae6-9d61-beb97c48b12d admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.718497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c107e1-e58a-4ae6-9d61-beb97c48b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.718772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c107e1-e58a-4ae6-9d61-beb97c48b12d admin admin] PATH_INFO: `/v3/projects/4d0dfdd48aee4dc9918d7634bacfb60a/users/171dbd957a0c4a62944bbacb90bf0e4d/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.741661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c107e1-e58a-4ae6-9d61-beb97c48b12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0dfdd48aee4dc9918d7634bacfb60a, user_id=171dbd957a0c4a62944bbacb90bf0e4d, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:24.745262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c107e1-e58a-4ae6-9d61-beb97c48b12d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.773086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e35341-f948-4b8b-b029-e2abf77780ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:24.774828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e35341-f948-4b8b-b029-e2abf77780ef service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.785543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1045/2105] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:24.786693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddd5f0-af46-453b-b801-7436db8d3d13 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.787129 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddd5f0-af46-453b-b801-7436db8d3d13 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.787355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddd5f0-af46-453b-b801-7436db8d3d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.805029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1061/2106] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:24 2022] PUT /identity/v3/projects/4d0dfdd48aee4dc9918d7634bacfb60a/users/171dbd957a0c4a62944bbacb90bf0e4d/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:24.806614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c107e1-e58a-4ae6-9d61-beb97c48b12d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:24.809445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a6c107e1-e58a-4ae6-9d61-beb97c48b12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:24.819440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cfddd5f0-af46-453b-b801-7436db8d3d13 None None] MFA Rules not processed for user `349c82d142254414af7702d036e69a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:24.821088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cfddd5f0-af46-453b-b801-7436db8d3d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:24.862992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:24.916501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c107e1-e58a-4ae6-9d61-beb97c48b12d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:24.921308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:24.922212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.922496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.922907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] PATH_INFO: `/v3/projects/0025aa9f920f45729d8516c9e315e448` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.924123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0025aa9f920f45729d8516c9e315e448)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:24.924848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:24.928238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:24.928356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1046/2107] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:24.932632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf622-8c74-498a-984c-df4712d353ec None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:24.932632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf622-8c74-498a-984c-df4712d353ec None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:24.932632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf622-8c74-498a-984c-df4712d353ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:24.964076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-896bf622-8c74-498a-984c-df4712d353ec None None] MFA Rules not processed for user `171dbd957a0c4a62944bbacb90bf0e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:24.965475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-896bf622-8c74-498a-984c-df4712d353ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.034033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1047/2108] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:25.034915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bf622-8c74-498a-984c-df4712d353ec None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.036286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-896bf622-8c74-498a-984c-df4712d353ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.077752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0025aa9f920f45729d8516c9e315e448', 'request_id': 'req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.088572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0025aa9f920f45729d8516c9e315e448', 'request_id': 'req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.120700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bf622-8c74-498a-984c-df4712d353ec None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.155464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0025aa9f920f45729d8516c9e315e448', 'request_id': 'req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.176410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b66c32-9580-44ea-bb90-3461a413a7b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.177194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b66c32-9580-44ea-bb90-3461a413a7b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.177476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b66c32-9580-44ea-bb90-3461a413a7b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.177749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b66c32-9580-44ea-bb90-3461a413a7b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.179432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] The token cache is being invalidate because project 0025aa9f920f45729d8516c9e315e448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:25.179851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.180090 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d9b66c32-9580-44ea-bb90-3461a413a7b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.180734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.184995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1062/2109] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:24 2022] DELETE /identity/v3/projects/0025aa9f920f45729d8516c9e315e448 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:25.186897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.189766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.249410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b66c32-9580-44ea-bb90-3461a413a7b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.251016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b66c32-9580-44ea-bb90-3461a413a7b9 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.260667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1048/2110] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:25.262161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18e371-2ee9-4dd4-9993-cc366fdf6005 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.262461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18e371-2ee9-4dd4-9993-cc366fdf6005 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.262799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18e371-2ee9-4dd4-9993-cc366fdf6005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.264709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931a7ec-0834-4f13-bcb9-b2d4de65b41f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.270574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4412e-7466-4928-beb9-7e8e5d90e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.271444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4412e-7466-4928-beb9-7e8e5d90e731 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.271862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4412e-7466-4928-beb9-7e8e5d90e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.272148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4412e-7466-4928-beb9-7e8e5d90e731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.272843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4412e-7466-4928-beb9-7e8e5d90e731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.274743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4412e-7466-4928-beb9-7e8e5d90e731 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.287995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-7c18e371-2ee9-4dd4-9993-cc366fdf6005 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:25.288386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7c18e371-2ee9-4dd4-9993-cc366fdf6005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.303378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1049/2111] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:25.324619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18e371-2ee9-4dd4-9993-cc366fdf6005 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.327293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7c18e371-2ee9-4dd4-9993-cc366fdf6005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.343075 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18e371-2ee9-4dd4-9993-cc366fdf6005 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.349645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.351413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.351755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.352041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] PATH_INFO: `/v3/projects/542bb8e17ee44f5a9fae0eb76e1068ef` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.353590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542bb8e17ee44f5a9fae0eb76e1068ef)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.357738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.377036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1063/2112] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:25 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:25.378541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab30e6-043d-4a83-a1f8-47904f0645ff None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.378925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab30e6-043d-4a83-a1f8-47904f0645ff None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.379432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab30e6-043d-4a83-a1f8-47904f0645ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.402574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4eab30e6-043d-4a83-a1f8-47904f0645ff None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:25.404033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4eab30e6-043d-4a83-a1f8-47904f0645ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.468547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1064/2113] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:25.469962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab30e6-043d-4a83-a1f8-47904f0645ff None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.480886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab30e6-043d-4a83-a1f8-47904f0645ff None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.485986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6463743-d2eb-4f92-a3d0-b0d7dc7f6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.486930 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6463743-d2eb-4f92-a3d0-b0d7dc7f6290 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.487236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6463743-d2eb-4f92-a3d0-b0d7dc7f6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.487505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6463743-d2eb-4f92-a3d0-b0d7dc7f6290 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.488198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6463743-d2eb-4f92-a3d0-b0d7dc7f6290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.490103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6463743-d2eb-4f92-a3d0-b0d7dc7f6290 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.501692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542bb8e17ee44f5a9fae0eb76e1068ef', 'request_id': 'req-234c1a3a-6aa5-4bae-af76-65327174e705'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.510549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542bb8e17ee44f5a9fae0eb76e1068ef', 'request_id': 'req-234c1a3a-6aa5-4bae-af76-65327174e705'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.529073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:25.595221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1065/2114] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:25 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:25.597336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542bb8e17ee44f5a9fae0eb76e1068ef', 'request_id': 'req-234c1a3a-6aa5-4bae-af76-65327174e705'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.599352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6463743-d2eb-4f92-a3d0-b0d7dc7f6290 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.600754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:25.610315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6463743-d2eb-4f92-a3d0-b0d7dc7f6290 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.614087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] The token cache is being invalidate because project 542bb8e17ee44f5a9fae0eb76e1068ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:25.614379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.615222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.618037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1050/2115] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:25 2022] DELETE /identity/v3/projects/542bb8e17ee44f5a9fae0eb76e1068ef => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:25.619080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.621780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.671647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.672308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.672585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.672859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.673583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:25.673890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.675492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.690467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1066/2116] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:25.690467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.690467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.692295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1a3a-6aa5-4bae-af76-65327174e705 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.697014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34659cff-65f2-440f-8205-64481493e26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.698379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34659cff-65f2-440f-8205-64481493e26d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.698661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34659cff-65f2-440f-8205-64481493e26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.698932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34659cff-65f2-440f-8205-64481493e26d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.699688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34659cff-65f2-440f-8205-64481493e26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.701267 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34659cff-65f2-440f-8205-64481493e26d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.703066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701f8c9-28b1-4c30-877c-de7d9b52d47a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.707729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.708589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.708918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.709192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] PATH_INFO: `/v3/users/047833afb34d46879b2a86be92fdc1e8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.710394 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=047833afb34d46879b2a86be92fdc1e8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.711379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1051/2117] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:25.712227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34659cff-65f2-440f-8205-64481493e26d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.712334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.717670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-34659cff-65f2-440f-8205-64481493e26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.737494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34659cff-65f2-440f-8205-64481493e26d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.745186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbb1f8-2d3b-4b23-bdd4-31807000cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.746102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbb1f8-2d3b-4b23-bdd4-31807000cf3d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.747290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbb1f8-2d3b-4b23-bdd4-31807000cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.747831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbb1f8-2d3b-4b23-bdd4-31807000cf3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.748774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbb1f8-2d3b-4b23-bdd4-31807000cf3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.750815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbb1f8-2d3b-4b23-bdd4-31807000cf3d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.840809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1052/2118] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:25 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:25.841981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbb1f8-2d3b-4b23-bdd4-31807000cf3d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.912796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbb1f8-2d3b-4b23-bdd4-31807000cf3d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.917688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b73bf7-783f-470a-a065-4bf74f298bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.918659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73bf7-783f-470a-a065-4bf74f298bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.918934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73bf7-783f-470a-a065-4bf74f298bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.919267 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73bf7-783f-470a-a065-4bf74f298bf7 admin admin] PATH_INFO: `/v3/projects/e534e0c3207942c0a251e8f7baa277b3/users/592674d899c34e9d981837ecc6f4a223/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.939764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b73bf7-783f-470a-a065-4bf74f298bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e534e0c3207942c0a251e8f7baa277b3, user_id=592674d899c34e9d981837ecc6f4a223, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.942743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b73bf7-783f-470a-a065-4bf74f298bf7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.943163 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047833afb34d46879b2a86be92fdc1e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.944099 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047833afb34d46879b2a86be92fdc1e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.945871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047833afb34d46879b2a86be92fdc1e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.962777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047833afb34d46879b2a86be92fdc1e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:25.971855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047833afb34d46879b2a86be92fdc1e8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.052859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1053/2119] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:25 2022] PUT /identity/v3/projects/e534e0c3207942c0a251e8f7baa277b3/users/592674d899c34e9d981837ecc6f4a223/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:26.053655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b73bf7-783f-470a-a065-4bf74f298bf7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.055403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e8b73bf7-783f-470a-a065-4bf74f298bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:26.088367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1067/2120] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:25 2022] DELETE /identity/v3/users/047833afb34d46879b2a86be92fdc1e8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:26.089763 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.093551 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:26.142529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b73bf7-783f-470a-a065-4bf74f298bf7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.173805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bb797-f254-4e45-8777-e70e868572cb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.178773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b42cd-06f5-48cb-8159-e38d764a8bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.179714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b42cd-06f5-48cb-8159-e38d764a8bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.180064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b42cd-06f5-48cb-8159-e38d764a8bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.180404 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b42cd-06f5-48cb-8159-e38d764a8bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.181214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b42cd-06f5-48cb-8159-e38d764a8bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.183557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b42cd-06f5-48cb-8159-e38d764a8bc5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.194846 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1068/2121] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:26.199243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b42cd-06f5-48cb-8159-e38d764a8bc5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.206695 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3fe53-1002-4fe1-8590-8452f8c21425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.207287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3fe53-1002-4fe1-8590-8452f8c21425 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.207637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3fe53-1002-4fe1-8590-8452f8c21425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.207968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3fe53-1002-4fe1-8590-8452f8c21425 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.208952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3fe53-1002-4fe1-8590-8452f8c21425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.210842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:26.210976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3fe53-1002-4fe1-8590-8452f8c21425 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.215015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b42cd-06f5-48cb-8159-e38d764a8bc5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.220791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2729c-fc6b-4fb6-be4f-11d68d857a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.221979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2729c-fc6b-4fb6-be4f-11d68d857a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.222331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2729c-fc6b-4fb6-be4f-11d68d857a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.222678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2729c-fc6b-4fb6-be4f-11d68d857a09 admin admin] PATH_INFO: `/v3/projects/e534e0c3207942c0a251e8f7baa277b3/users/592674d899c34e9d981837ecc6f4a223/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.225350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2729c-fc6b-4fb6-be4f-11d68d857a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e534e0c3207942c0a251e8f7baa277b3, user_id=592674d899c34e9d981837ecc6f4a223, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.228254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2729c-fc6b-4fb6-be4f-11d68d857a09 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.239252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1069/2122] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:26 2022] PUT /identity/v3/projects/e534e0c3207942c0a251e8f7baa277b3/users/592674d899c34e9d981837ecc6f4a223/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:26.250080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc9f0d-8a2d-4f96-a0e6-75c7259aae2b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.250367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc9f0d-8a2d-4f96-a0e6-75c7259aae2b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.250641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc9f0d-8a2d-4f96-a0e6-75c7259aae2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.280269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ebfc9f0d-8a2d-4f96-a0e6-75c7259aae2b None None] MFA Rules not processed for user `592674d899c34e9d981837ecc6f4a223`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:26.281515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ebfc9f0d-8a2d-4f96-a0e6-75c7259aae2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:26.286280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:26.353289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1070/2123] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:26.356266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1054/2124] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:26 2022] POST /identity/v3/users => generated 295 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:26.360334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc9f0d-8a2d-4f96-a0e6-75c7259aae2b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.364984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3fe53-1002-4fe1-8590-8452f8c21425 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.366817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-44c3fe53-1002-4fe1-8590-8452f8c21425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:26.428767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc9f0d-8a2d-4f96-a0e6-75c7259aae2b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.429036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3fe53-1002-4fe1-8590-8452f8c21425 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.433969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04fae1-77b8-4a9d-b47e-70e1a34adf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.434651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04fae1-77b8-4a9d-b47e-70e1a34adf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.435049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04fae1-77b8-4a9d-b47e-70e1a34adf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.435357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04fae1-77b8-4a9d-b47e-70e1a34adf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.436085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04fae1-77b8-4a9d-b47e-70e1a34adf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.437661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04fae1-77b8-4a9d-b47e-70e1a34adf14 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.453303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1071/2125] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:26.454146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04fae1-77b8-4a9d-b47e-70e1a34adf14 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.464628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04fae1-77b8-4a9d-b47e-70e1a34adf14 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.473323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03ff8-b1da-4ed2-9455-6efa0d2b4b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.474035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03ff8-b1da-4ed2-9455-6efa0d2b4b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.474344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03ff8-b1da-4ed2-9455-6efa0d2b4b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.474584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03ff8-b1da-4ed2-9455-6efa0d2b4b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.475369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03ff8-b1da-4ed2-9455-6efa0d2b4b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.477055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03ff8-b1da-4ed2-9455-6efa0d2b4b66 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.486730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac9e29-f4ff-4742-9a56-2d5109db8c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.487441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac9e29-f4ff-4742-9a56-2d5109db8c9c service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.491377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1072/2126] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:26.491621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac9e29-f4ff-4742-9a56-2d5109db8c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.491952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac9e29-f4ff-4742-9a56-2d5109db8c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.492338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03ff8-b1da-4ed2-9455-6efa0d2b4b66 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.502662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac9e29-f4ff-4742-9a56-2d5109db8c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.504129 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac9e29-f4ff-4742-9a56-2d5109db8c9c service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.504250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03ff8-b1da-4ed2-9455-6efa0d2b4b66 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.508946 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dab43-7420-4fd4-8acf-42d80e187f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.509893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dab43-7420-4fd4-8acf-42d80e187f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.511129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dab43-7420-4fd4-8acf-42d80e187f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.511414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dab43-7420-4fd4-8acf-42d80e187f25 admin admin] PATH_INFO: `/v3/projects/a083c564db474e80af22b7c21af82775/users/5a6e44ab0c394541a7d7b290928ea6f8/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.515437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1055/2127] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:26.528278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dab43-7420-4fd4-8acf-42d80e187f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a083c564db474e80af22b7c21af82775, user_id=5a6e44ab0c394541a7d7b290928ea6f8, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.531694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dab43-7420-4fd4-8acf-42d80e187f25 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.581416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac9e29-f4ff-4742-9a56-2d5109db8c9c service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.582795 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-feac9e29-f4ff-4742-9a56-2d5109db8c9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:26.601863 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac9e29-f4ff-4742-9a56-2d5109db8c9c service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.605746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1073/2128] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:26 2022] PUT /identity/v3/projects/a083c564db474e80af22b7c21af82775/users/5a6e44ab0c394541a7d7b290928ea6f8/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:26.611493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe104-fb3e-4d63-bc26-eb343149724b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.612246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe104-fb3e-4d63-bc26-eb343149724b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.612246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe104-fb3e-4d63-bc26-eb343149724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.637952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4b5fe104-fb3e-4d63-bc26-eb343149724b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:26.639548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4b5fe104-fb3e-4d63-bc26-eb343149724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:26.658426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:26.681106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.682822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.683809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.684099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] PATH_INFO: `/v3/users/f8b217ce1ef4481685e40fa48d638074` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.685485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b217ce1ef4481685e40fa48d638074)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.688134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.712677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1074/2129] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:26.713866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe104-fb3e-4d63-bc26-eb343149724b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.723241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe104-fb3e-4d63-bc26-eb343149724b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.727942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.729315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.729598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.729871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] PATH_INFO: `/v3/users/171dbd957a0c4a62944bbacb90bf0e4d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.731207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=171dbd957a0c4a62944bbacb90bf0e4d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.733099 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.786269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:26.890163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b217ce1ef4481685e40fa48d638074'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.890814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b217ce1ef4481685e40fa48d638074'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.903082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b217ce1ef4481685e40fa48d638074'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.909752 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b217ce1ef4481685e40fa48d638074'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.910309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b217ce1ef4481685e40fa48d638074'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.925236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171dbd957a0c4a62944bbacb90bf0e4d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.925900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171dbd957a0c4a62944bbacb90bf0e4d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.926624 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171dbd957a0c4a62944bbacb90bf0e4d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.938254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171dbd957a0c4a62944bbacb90bf0e4d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.940137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:26.945165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171dbd957a0c4a62944bbacb90bf0e4d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.985452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1056/2130] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:26 2022] DELETE /identity/v3/users/f8b217ce1ef4481685e40fa48d638074 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:26.986415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.987844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.047672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e168e-859c-49b6-b8e2-a9f223880582 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.052438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa8a03-d636-41e4-a442-e3a64a81dea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.053141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa8a03-d636-41e4-a442-e3a64a81dea2 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.053680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa8a03-d636-41e4-a442-e3a64a81dea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.053680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa8a03-d636-41e4-a442-e3a64a81dea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.056228 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cbaa8a03-d636-41e4-a442-e3a64a81dea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.073273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1075/2131] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:26 2022] DELETE /identity/v3/users/171dbd957a0c4a62944bbacb90bf0e4d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:27.074243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.076352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.142736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa8a03-d636-41e4-a442-e3a64a81dea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.144524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa8a03-d636-41e4-a442-e3a64a81dea2 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.148731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe4877-c6ae-4841-82e0-c0e99eebd117 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.154921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.155909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.156173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.156442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] PATH_INFO: `/v3/projects/efebc2cc1524488eb180a51fa74070d2` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.157895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] RBAC: Authorizing `identity:delete_project(project_id=efebc2cc1524488eb180a51fa74070d2)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.160246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.161985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1057/2132] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:27.164010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a36701-e14f-4837-b53c-4d4099117759 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.164438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a36701-e14f-4837-b53c-4d4099117759 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.165284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a36701-e14f-4837-b53c-4d4099117759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.187680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-45a36701-e14f-4837-b53c-4d4099117759 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:27.188886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-45a36701-e14f-4837-b53c-4d4099117759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.198242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1058/2133] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:27.212512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a36701-e14f-4837-b53c-4d4099117759 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.214491 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-45a36701-e14f-4837-b53c-4d4099117759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.278135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a36701-e14f-4837-b53c-4d4099117759 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.281912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14523f-805d-4fad-9e9f-c2393a93909f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.282557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14523f-805d-4fad-9e9f-c2393a93909f service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.287670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14523f-805d-4fad-9e9f-c2393a93909f service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.287670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14523f-805d-4fad-9e9f-c2393a93909f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.292902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14523f-805d-4fad-9e9f-c2393a93909f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.294278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14523f-805d-4fad-9e9f-c2393a93909f service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.304239 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1059/2134] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:27.322040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efebc2cc1524488eb180a51fa74070d2', 'request_id': 'req-608d1358-3bc5-421c-b436-ce0cf26f387d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.329692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efebc2cc1524488eb180a51fa74070d2', 'request_id': 'req-608d1358-3bc5-421c-b436-ce0cf26f387d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.340715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14523f-805d-4fad-9e9f-c2393a93909f service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.342153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ca14523f-805d-4fad-9e9f-c2393a93909f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.355644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14523f-805d-4fad-9e9f-c2393a93909f service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.426212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.426978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.427282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.427555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] PATH_INFO: `/v3/projects/b4dd2535b9924220a173a94c3cd4c70c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.428731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4dd2535b9924220a173a94c3cd4c70c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.430944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.433736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efebc2cc1524488eb180a51fa74070d2', 'request_id': 'req-608d1358-3bc5-421c-b436-ce0cf26f387d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.449968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] The token cache is being invalidate because project efebc2cc1524488eb180a51fa74070d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:27.450258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.450928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.454268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1076/2135] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:27 2022] DELETE /identity/v3/projects/efebc2cc1524488eb180a51fa74070d2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:27.458825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.468297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.484511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d1358-3bc5-421c-b436-ce0cf26f387d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.489323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.490194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.490473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.490745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] PATH_INFO: `/v3/users/a4f78c651d4b47cb86b6809edeee784e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.491968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f78c651d4b47cb86b6809edeee784e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.497760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.573958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4dd2535b9924220a173a94c3cd4c70c', 'request_id': 'req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.585048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4dd2535b9924220a173a94c3cd4c70c', 'request_id': 'req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.661742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4dd2535b9924220a173a94c3cd4c70c', 'request_id': 'req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.680066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] The token cache is being invalidate because project b4dd2535b9924220a173a94c3cd4c70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:27.680371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.681351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.683654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1060/2136] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:27 2022] DELETE /identity/v3/projects/b4dd2535b9924220a173a94c3cd4c70c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:27.688133 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.689677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.728520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f78c651d4b47cb86b6809edeee784e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.729979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f78c651d4b47cb86b6809edeee784e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.730968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f78c651d4b47cb86b6809edeee784e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.758731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f78c651d4b47cb86b6809edeee784e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.766355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f78c651d4b47cb86b6809edeee784e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.780336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f1ac-c6bd-4f3b-8f5a-feecc1a7de93 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.786730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.787834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.788189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.789427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] PATH_INFO: `/v3/users/d10da5a94dd5418b8933ca3bf2d505b2` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.790633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10da5a94dd5418b8933ca3bf2d505b2)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.792777 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.863732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1077/2137] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:27 2022] DELETE /identity/v3/users/a4f78c651d4b47cb86b6809edeee784e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:27.929784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.933947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:28.014653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10da5a94dd5418b8933ca3bf2d505b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.015843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10da5a94dd5418b8933ca3bf2d505b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.023696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:28.026702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36b640-07e0-4ca1-b587-a3b8fa01eb31 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:28.028396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10da5a94dd5418b8933ca3bf2d505b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.032972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:28.032972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:28.032972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:28.033449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] PATH_INFO: `/v3/projects/4d0dfdd48aee4dc9918d7634bacfb60a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:28.034622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0dfdd48aee4dc9918d7634bacfb60a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:28.035515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10da5a94dd5418b8933ca3bf2d505b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.036189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10da5a94dd5418b8933ca3bf2d505b2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.036531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:28.131193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1061/2138] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:27 2022] DELETE /identity/v3/users/d10da5a94dd5418b8933ca3bf2d505b2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:28.141173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0dfdd48aee4dc9918d7634bacfb60a', 'request_id': 'req-03053a38-7ead-4568-b620-f51418a6d794'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.148330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0dfdd48aee4dc9918d7634bacfb60a', 'request_id': 'req-03053a38-7ead-4568-b620-f51418a6d794'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.217647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0dfdd48aee4dc9918d7634bacfb60a', 'request_id': 'req-03053a38-7ead-4568-b620-f51418a6d794'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.221280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:28.233269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] The token cache is being invalidate because project 4d0dfdd48aee4dc9918d7634bacfb60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:28.233556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.234211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.236154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1078/2139] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:27 2022] DELETE /identity/v3/projects/4d0dfdd48aee4dc9918d7634bacfb60a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:28.239954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:28.241566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:28.360508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dd691-06ad-413f-9b3b-62b3ef51e2c2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:28.365540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:28.366455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:28.366830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:28.367144 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] PATH_INFO: `/v3/users/592674d899c34e9d981837ecc6f4a223` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:28.370647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=592674d899c34e9d981837ecc6f4a223)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:28.370647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:28.521566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:28.523321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:28.593661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03053a38-7ead-4568-b620-f51418a6d794 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:28.598677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:28.606207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:28.606207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:28.606207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] PATH_INFO: `/v3/projects/83d4881ebf52448fb2fef8d50bae21d8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:28.606207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d4881ebf52448fb2fef8d50bae21d8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:28.606571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:28.616507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592674d899c34e9d981837ecc6f4a223'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.617742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592674d899c34e9d981837ecc6f4a223'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.630560 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592674d899c34e9d981837ecc6f4a223'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.637998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592674d899c34e9d981837ecc6f4a223'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.638722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592674d899c34e9d981837ecc6f4a223'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.710826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1062/2140] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:28 2022] DELETE /identity/v3/users/592674d899c34e9d981837ecc6f4a223 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:28.711925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:28.718443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:28.745170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d4881ebf52448fb2fef8d50bae21d8', 'request_id': 'req-ee37e419-5463-4c6f-93f5-9c3e45900616'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.752972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d4881ebf52448fb2fef8d50bae21d8', 'request_id': 'req-ee37e419-5463-4c6f-93f5-9c3e45900616'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.802990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3efe-c787-4fd5-a391-519891990c6d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:28.808522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:28.809388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:28.809670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:28.810132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] PATH_INFO: `/v3/projects/db56a229a5a6408883a58eceef3dcb8e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:28.811372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db56a229a5a6408883a58eceef3dcb8e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:28.815632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:28.872087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d4881ebf52448fb2fef8d50bae21d8', 'request_id': 'req-ee37e419-5463-4c6f-93f5-9c3e45900616'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.883380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] The token cache is being invalidate because project 83d4881ebf52448fb2fef8d50bae21d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:28.883666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.884299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ee37e419-5463-4c6f-93f5-9c3e45900616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.886384 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1079/2141] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:28 2022] DELETE /identity/v3/projects/83d4881ebf52448fb2fef8d50bae21d8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:28.891158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edc9b-530b-4baf-a500-c39eb4caeafb None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:28.891443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edc9b-530b-4baf-a500-c39eb4caeafb None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:28.891716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edc9b-530b-4baf-a500-c39eb4caeafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:28.915319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-568edc9b-530b-4baf-a500-c39eb4caeafb None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:28.916583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-568edc9b-530b-4baf-a500-c39eb4caeafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:28.944552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1080/2142] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:28.954095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fa958-57b6-4e21-a39c-bd6240e2d6c5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:28.954385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fa958-57b6-4e21-a39c-bd6240e2d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:28.954656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fa958-57b6-4e21-a39c-bd6240e2d6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:28.956439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db56a229a5a6408883a58eceef3dcb8e', 'request_id': 'req-958825c2-bf90-44c7-bc32-428bb07457e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.968395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db56a229a5a6408883a58eceef3dcb8e', 'request_id': 'req-958825c2-bf90-44c7-bc32-428bb07457e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:28.986585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f78fa958-57b6-4e21-a39c-bd6240e2d6c5 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:28.987986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f78fa958-57b6-4e21-a39c-bd6240e2d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.043203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db56a229a5a6408883a58eceef3dcb8e', 'request_id': 'req-958825c2-bf90-44c7-bc32-428bb07457e5'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:29.060638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] The token cache is being invalidate because project db56a229a5a6408883a58eceef3dcb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:29.060957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:29.061772 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-958825c2-bf90-44c7-bc32-428bb07457e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:29.065062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1063/2143] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:28 2022] DELETE /identity/v3/projects/db56a229a5a6408883a58eceef3dcb8e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:29.075343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1081/2144] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:29.080724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6684907-1bb9-4374-8338-ccc7fe0600fa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.080724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6684907-1bb9-4374-8338-ccc7fe0600fa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.080724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6684907-1bb9-4374-8338-ccc7fe0600fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.084192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fa958-57b6-4e21-a39c-bd6240e2d6c5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.097971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fa958-57b6-4e21-a39c-bd6240e2d6c5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.103083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a58f78-2778-4397-8ca0-03bd163485c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.103945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a58f78-2778-4397-8ca0-03bd163485c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.104293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a58f78-2778-4397-8ca0-03bd163485c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.104968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a58f78-2778-4397-8ca0-03bd163485c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.105292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a58f78-2778-4397-8ca0-03bd163485c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:29.105599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a58f78-2778-4397-8ca0-03bd163485c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.107255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a58f78-2778-4397-8ca0-03bd163485c4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.110030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a6684907-1bb9-4374-8338-ccc7fe0600fa None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:29.111347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a6684907-1bb9-4374-8338-ccc7fe0600fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.121131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1064/2145] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:29.130538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1082/2146] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:29.130632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c882723-b156-48bb-89a9-5f4d78377a6f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.130632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c882723-b156-48bb-89a9-5f4d78377a6f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.131199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c882723-b156-48bb-89a9-5f4d78377a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.131548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a58f78-2778-4397-8ca0-03bd163485c4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.142480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a58f78-2778-4397-8ca0-03bd163485c4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.147651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b46f7-714e-4503-9352-4deca21389d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.150327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b46f7-714e-4503-9352-4deca21389d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.150327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b46f7-714e-4503-9352-4deca21389d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.150327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b46f7-714e-4503-9352-4deca21389d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.150327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b46f7-714e-4503-9352-4deca21389d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.151581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b46f7-714e-4503-9352-4deca21389d5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.157922 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1c882723-b156-48bb-89a9-5f4d78377a6f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:29.159325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1c882723-b156-48bb-89a9-5f4d78377a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.168796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1065/2147] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:29.170507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:29.172559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c882723-b156-48bb-89a9-5f4d78377a6f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.181618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c882723-b156-48bb-89a9-5f4d78377a6f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.187048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.187761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.188043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.188319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.189044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:29.189723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.191606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.207287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1066/2148] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:29.208235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.210390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.223640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51613a4-438a-4238-ae9d-192253cef0ea admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.229663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.229663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.229663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.230081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] PATH_INFO: `/v3/projects/e534e0c3207942c0a251e8f7baa277b3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.231199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e534e0c3207942c0a251e8f7baa277b3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.232964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.293115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1083/2149] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:29.297974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b46f7-714e-4503-9352-4deca21389d5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.377637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b46f7-714e-4503-9352-4deca21389d5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.394783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e534e0c3207942c0a251e8f7baa277b3', 'request_id': 'req-7041a62f-23e2-4ab4-b3b8-ee76614305d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:29.404131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e534e0c3207942c0a251e8f7baa277b3', 'request_id': 'req-7041a62f-23e2-4ab4-b3b8-ee76614305d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:29.456118 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa9ce5-bc64-4adb-95d0-f15668477b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.456795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa9ce5-bc64-4adb-95d0-f15668477b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.457080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa9ce5-bc64-4adb-95d0-f15668477b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.457366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa9ce5-bc64-4adb-95d0-f15668477b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.458203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa9ce5-bc64-4adb-95d0-f15668477b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.460057 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa9ce5-bc64-4adb-95d0-f15668477b57 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.491490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e534e0c3207942c0a251e8f7baa277b3', 'request_id': 'req-7041a62f-23e2-4ab4-b3b8-ee76614305d9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:29.502938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] The token cache is being invalidate because project e534e0c3207942c0a251e8f7baa277b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:29.503280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:29.503941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:29.505559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1067/2150] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:29 2022] DELETE /identity/v3/projects/e534e0c3207942c0a251e8f7baa277b3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:29.508980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.508980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.521184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041a62f-23e2-4ab4-b3b8-ee76614305d9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.530017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336b64d-9130-41b5-8bc4-a323881c64b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.530017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336b64d-9130-41b5-8bc4-a323881c64b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.530017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336b64d-9130-41b5-8bc4-a323881c64b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.530017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336b64d-9130-41b5-8bc4-a323881c64b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.530401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336b64d-9130-41b5-8bc4-a323881c64b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.530401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336b64d-9130-41b5-8bc4-a323881c64b4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.591536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:29.608147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1084/2151] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/projects => generated 371 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:29.614313 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f375a43-8fc2-46b6-8a0c-16e6bab38dd7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.618006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f375a43-8fc2-46b6-8a0c-16e6bab38dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.618453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f375a43-8fc2-46b6-8a0c-16e6bab38dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.635606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1068/2152] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:29.643991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336b64d-9130-41b5-8bc4-a323881c64b4 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.643991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0336b64d-9130-41b5-8bc4-a323881c64b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.644167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4f375a43-8fc2-46b6-8a0c-16e6bab38dd7 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:29.644167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4f375a43-8fc2-46b6-8a0c-16e6bab38dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.651552 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336b64d-9130-41b5-8bc4-a323881c64b4 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.736795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1085/2153] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:29.738104 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f375a43-8fc2-46b6-8a0c-16e6bab38dd7 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.739310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3118d-8d61-4044-9bf3-cbfc5808199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.740282 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3118d-8d61-4044-9bf3-cbfc5808199f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.740570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3118d-8d61-4044-9bf3-cbfc5808199f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.750935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f375a43-8fc2-46b6-8a0c-16e6bab38dd7 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.752432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3118d-8d61-4044-9bf3-cbfc5808199f admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.753326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3118d-8d61-4044-9bf3-cbfc5808199f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.755287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3118d-8d61-4044-9bf3-cbfc5808199f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.761951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9b13e-1bab-4e3c-b652-f7ca764fafe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.761951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b13e-1bab-4e3c-b652-f7ca764fafe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.761951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b13e-1bab-4e3c-b652-f7ca764fafe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.761951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b13e-1bab-4e3c-b652-f7ca764fafe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.762477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9b13e-1bab-4e3c-b652-f7ca764fafe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.762477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9b13e-1bab-4e3c-b652-f7ca764fafe2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.775001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1086/2154] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:29.776548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc078f-a3f4-4608-82d3-495cf2e0dbba None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.776840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc078f-a3f4-4608-82d3-495cf2e0dbba None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.777120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc078f-a3f4-4608-82d3-495cf2e0dbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.796860 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-51cc078f-a3f4-4608-82d3-495cf2e0dbba None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:29.798090 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-51cc078f-a3f4-4608-82d3-495cf2e0dbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.808264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1087/2155] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:29.809128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc078f-a3f4-4608-82d3-495cf2e0dbba None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.822085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc078f-a3f4-4608-82d3-495cf2e0dbba None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.827346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9d0fe-1a9b-466d-a828-7742e5ba55ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.828019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9d0fe-1a9b-466d-a828-7742e5ba55ef admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.828300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9d0fe-1a9b-466d-a828-7742e5ba55ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.828577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9d0fe-1a9b-466d-a828-7742e5ba55ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.829297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9d0fe-1a9b-466d-a828-7742e5ba55ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.830980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9d0fe-1a9b-466d-a828-7742e5ba55ef admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.842917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1088/2156] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:29.843785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9d0fe-1a9b-466d-a828-7742e5ba55ef admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.854669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9d0fe-1a9b-466d-a828-7742e5ba55ef admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.859476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d918986-dbdc-4f78-b09a-c37e73f7708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.860130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d918986-dbdc-4f78-b09a-c37e73f7708c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.860440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d918986-dbdc-4f78-b09a-c37e73f7708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.860718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d918986-dbdc-4f78-b09a-c37e73f7708c admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.861520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d918986-dbdc-4f78-b09a-c37e73f7708c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:29.861826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d918986-dbdc-4f78-b09a-c37e73f7708c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.863432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d918986-dbdc-4f78-b09a-c37e73f7708c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.876667 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1089/2157] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:29.877475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d918986-dbdc-4f78-b09a-c37e73f7708c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.897673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d918986-dbdc-4f78-b09a-c37e73f7708c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.903207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748440d-c6b3-4adb-8822-5ab09ac0e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.905503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748440d-c6b3-4adb-8822-5ab09ac0e4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.905956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748440d-c6b3-4adb-8822-5ab09ac0e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.907662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748440d-c6b3-4adb-8822-5ab09ac0e4f9 admin admin] PATH_INFO: `/v3/projects/1e6454f8d2f14800b29c2ce42e6d4a83/users/264e70534a654039929983893eef4d6e/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.916987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1069/2158] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/users => generated 286 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:29.916987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3118d-8d61-4044-9bf3-cbfc5808199f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.925601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748440d-c6b3-4adb-8822-5ab09ac0e4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6454f8d2f14800b29c2ce42e6d4a83, user_id=264e70534a654039929983893eef4d6e, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.932755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748440d-c6b3-4adb-8822-5ab09ac0e4f9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.933201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3118d-8d61-4044-9bf3-cbfc5808199f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.952000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bde6e8-d2d9-4e99-825d-40134611ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.952677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bde6e8-d2d9-4e99-825d-40134611ed6c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.952961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bde6e8-d2d9-4e99-825d-40134611ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.953236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bde6e8-d2d9-4e99-825d-40134611ed6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.954039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bde6e8-d2d9-4e99-825d-40134611ed6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:30.013322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bde6e8-d2d9-4e99-825d-40134611ed6c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:30.429422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1090/2159] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:29 2022] PUT /identity/v3/projects/1e6454f8d2f14800b29c2ce42e6d4a83/users/264e70534a654039929983893eef4d6e/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:30.432614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748440d-c6b3-4adb-8822-5ab09ac0e4f9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:30.433842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1070/2160] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/projects => generated 383 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:30.444151 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bde6e8-d2d9-4e99-825d-40134611ed6c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:30.520805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748440d-c6b3-4adb-8822-5ab09ac0e4f9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:30.554223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bde6e8-d2d9-4e99-825d-40134611ed6c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:30.560794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085b570-815c-4f7c-bcb8-7d5760446415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:30.561567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b570-815c-4f7c-bcb8-7d5760446415 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:30.561920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b570-815c-4f7c-bcb8-7d5760446415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:30.562306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b570-815c-4f7c-bcb8-7d5760446415 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:30.563322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085b570-815c-4f7c-bcb8-7d5760446415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:30.565459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085b570-815c-4f7c-bcb8-7d5760446415 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:30.595038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d24975-f2c1-41fe-970f-549c5a82e785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:30.595797 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24975-f2c1-41fe-970f-549c5a82e785 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:30.596056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24975-f2c1-41fe-970f-549c5a82e785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:30.596436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24975-f2c1-41fe-970f-549c5a82e785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:30.597220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d24975-f2c1-41fe-970f-549c5a82e785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:30.599030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d24975-f2c1-41fe-970f-549c5a82e785 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:30.613662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1091/2161] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:30.618632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ab35-c423-4b9f-b4f7-af2ed172d646 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:30.618632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ab35-c423-4b9f-b4f7-af2ed172d646 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:30.618632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ab35-c423-4b9f-b4f7-af2ed172d646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:30.643628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d735ab35-c423-4b9f-b4f7-af2ed172d646 None None] MFA Rules not processed for user `264e70534a654039929983893eef4d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:30.644923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d735ab35-c423-4b9f-b4f7-af2ed172d646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:30.649444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1071/2162] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:30 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:30.655688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085b570-815c-4f7c-bcb8-7d5760446415 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:30.670602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085b570-815c-4f7c-bcb8-7d5760446415 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:30.676516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138d08c-1d4f-4d1b-a9e6-ea85c1a9abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:30.677079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138d08c-1d4f-4d1b-a9e6-ea85c1a9abe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:30.677439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138d08c-1d4f-4d1b-a9e6-ea85c1a9abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:30.677697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138d08c-1d4f-4d1b-a9e6-ea85c1a9abe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:30.678365 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138d08c-1d4f-4d1b-a9e6-ea85c1a9abe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:30.680220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138d08c-1d4f-4d1b-a9e6-ea85c1a9abe9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:30.691974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1072/2163] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:30.696320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138d08c-1d4f-4d1b-a9e6-ea85c1a9abe9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:30.704163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138d08c-1d4f-4d1b-a9e6-ea85c1a9abe9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:30.709616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d97fd-1314-4495-9ec3-9c03d05a4482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:30.710310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d97fd-1314-4495-9ec3-9c03d05a4482 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:30.710595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d97fd-1314-4495-9ec3-9c03d05a4482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:30.711034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d97fd-1314-4495-9ec3-9c03d05a4482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:30.711794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d97fd-1314-4495-9ec3-9c03d05a4482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:30.714156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d97fd-1314-4495-9ec3-9c03d05a4482 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:30.728531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1092/2164] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:30.728531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735ab35-c423-4b9f-b4f7-af2ed172d646 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:30.729452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1073/2165] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:30.735793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d97fd-1314-4495-9ec3-9c03d05a4482 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:30.744422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735ab35-c423-4b9f-b4f7-af2ed172d646 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:30.763422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bcb03-3c45-4bda-9662-2c5cc6459b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:30.764854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bcb03-3c45-4bda-9662-2c5cc6459b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:30.765357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bcb03-3c45-4bda-9662-2c5cc6459b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:30.765826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bcb03-3c45-4bda-9662-2c5cc6459b59 admin admin] PATH_INFO: `/v3/projects/f92a29e9893b48ab95423613f7b38bfd/users/b0f3efdb20bf4409a586c4e03fb7628c/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:30.771340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d97fd-1314-4495-9ec3-9c03d05a4482 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:30.777176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71257-f330-45fe-8582-eddbf3e09e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:30.782281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71257-f330-45fe-8582-eddbf3e09e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:30.782281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71257-f330-45fe-8582-eddbf3e09e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:30.782281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71257-f330-45fe-8582-eddbf3e09e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:30.782281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c71257-f330-45fe-8582-eddbf3e09e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:30.782281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c71257-f330-45fe-8582-eddbf3e09e40 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:30.787999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bcb03-3c45-4bda-9662-2c5cc6459b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92a29e9893b48ab95423613f7b38bfd, user_id=b0f3efdb20bf4409a586c4e03fb7628c, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:30.793868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bcb03-3c45-4bda-9662-2c5cc6459b59 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:30.795243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1074/2166] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:30.796493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71257-f330-45fe-8582-eddbf3e09e40 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:30.798330 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-49c71257-f330-45fe-8582-eddbf3e09e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:30.882509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71257-f330-45fe-8582-eddbf3e09e40 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:30.891831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f52c6-de2f-4740-9d0c-2f4be04dcbbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:30.892677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f52c6-de2f-4740-9d0c-2f4be04dcbbf service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:30.893135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f52c6-de2f-4740-9d0c-2f4be04dcbbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:30.893763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f52c6-de2f-4740-9d0c-2f4be04dcbbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:30.907176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f52c6-de2f-4740-9d0c-2f4be04dcbbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:30.913292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f52c6-de2f-4740-9d0c-2f4be04dcbbf service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:30.924197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1093/2167] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:30 2022] PUT /identity/v3/projects/f92a29e9893b48ab95423613f7b38bfd/users/b0f3efdb20bf4409a586c4e03fb7628c/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:30.938354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bcb03-3c45-4bda-9662-2c5cc6459b59 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:30.939182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1075/2168] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:30.940887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eba23f-cce3-4090-9cc0-8c546012d384 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:30.941238 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eba23f-cce3-4090-9cc0-8c546012d384 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:30.941635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eba23f-cce3-4090-9cc0-8c546012d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:30.990113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e9eba23f-cce3-4090-9cc0-8c546012d384 None None] MFA Rules not processed for user `b0f3efdb20bf4409a586c4e03fb7628c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:30.992419 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e9eba23f-cce3-4090-9cc0-8c546012d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:31.092518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bcb03-3c45-4bda-9662-2c5cc6459b59 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:31.111524 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc425bb7-3698-4662-aac7-4e3392555025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:31.112859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc425bb7-3698-4662-aac7-4e3392555025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:31.113424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc425bb7-3698-4662-aac7-4e3392555025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:31.114241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc425bb7-3698-4662-aac7-4e3392555025 admin admin] PATH_INFO: `/v3/projects/26ca9af9796e47aebb2a35bc39b47472/users/8ba592ede7b448c18fc2e92b5de0c82e/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:31.137363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc425bb7-3698-4662-aac7-4e3392555025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ca9af9796e47aebb2a35bc39b47472, user_id=8ba592ede7b448c18fc2e92b5de0c82e, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:31.141497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc425bb7-3698-4662-aac7-4e3392555025 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:31.146881 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1076/2169] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:31.159137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eba23f-cce3-4090-9cc0-8c546012d384 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:31.159834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e9eba23f-cce3-4090-9cc0-8c546012d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:31.181058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:31.234156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eba23f-cce3-4090-9cc0-8c546012d384 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:31.238210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957076a-7bf8-45c4-ba09-75616a19683f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbc657ed3ae49dc9d45687c5dde2ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:31.238902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957076a-7bf8-45c4-ba09-75616a19683f service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:31.239232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957076a-7bf8-45c4-ba09-75616a19683f service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:31.239585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957076a-7bf8-45c4-ba09-75616a19683f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:31.251538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957076a-7bf8-45c4-ba09-75616a19683f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:31.252987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957076a-7bf8-45c4-ba09-75616a19683f service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:31.261741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1094/2170] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:30 2022] PUT /identity/v3/projects/26ca9af9796e47aebb2a35bc39b47472/users/8ba592ede7b448c18fc2e92b5de0c82e/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:31.263477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d81e-7490-4582-b1ab-3d9493a490bc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:31.264498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d81e-7490-4582-b1ab-3d9493a490bc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:31.264949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d81e-7490-4582-b1ab-3d9493a490bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:31.272569 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1077/2171] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:31.310955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0871d81e-7490-4582-b1ab-3d9493a490bc None None] MFA Rules not processed for user `8ba592ede7b448c18fc2e92b5de0c82e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:31.312485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0871d81e-7490-4582-b1ab-3d9493a490bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:31.394600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1095/2172] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:31.399343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957076a-7bf8-45c4-ba09-75616a19683f service glance] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:31.420003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957076a-7bf8-45c4-ba09-75616a19683f service glance] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:31.483921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c96cce-e7c4-4828-ba5a-15b750ca34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:31.484579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c96cce-e7c4-4828-ba5a-15b750ca34d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:31.484864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c96cce-e7c4-4828-ba5a-15b750ca34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:31.485137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c96cce-e7c4-4828-ba5a-15b750ca34d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:31.485823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c96cce-e7c4-4828-ba5a-15b750ca34d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:31.487780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c96cce-e7c4-4828-ba5a-15b750ca34d2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:31.519328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:31.650224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1078/2173] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:31 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:31.651562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d81e-7490-4582-b1ab-3d9493a490bc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:31.663153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d81e-7490-4582-b1ab-3d9493a490bc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:31.719789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a260c98-cb8d-4802-9b91-8b2c800fb7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:31.720458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260c98-cb8d-4802-9b91-8b2c800fb7bf admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:31.720788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260c98-cb8d-4802-9b91-8b2c800fb7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:31.721045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260c98-cb8d-4802-9b91-8b2c800fb7bf admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:31.721728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a260c98-cb8d-4802-9b91-8b2c800fb7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:31.723655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a260c98-cb8d-4802-9b91-8b2c800fb7bf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:31.849331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1096/2174] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:31 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:31.853210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c96cce-e7c4-4828-ba5a-15b750ca34d2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:31.864542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c96cce-e7c4-4828-ba5a-15b750ca34d2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:31.872902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f2434-2521-4648-b7cd-d5fc33500e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:31.875620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f2434-2521-4648-b7cd-d5fc33500e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:31.875620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f2434-2521-4648-b7cd-d5fc33500e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:31.875620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f2434-2521-4648-b7cd-d5fc33500e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:31.875620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f2434-2521-4648-b7cd-d5fc33500e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:31.877099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f2434-2521-4648-b7cd-d5fc33500e02 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:31.897671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1079/2175] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:31.898879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a260c98-cb8d-4802-9b91-8b2c800fb7bf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:31.910632 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a260c98-cb8d-4802-9b91-8b2c800fb7bf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:31.927824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5670c-aa70-49b2-ada2-fa9b2d432604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:31.929329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5670c-aa70-49b2-ada2-fa9b2d432604 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:31.935832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5670c-aa70-49b2-ada2-fa9b2d432604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:31.935832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5670c-aa70-49b2-ada2-fa9b2d432604 admin admin] PATH_INFO: `/v3/projects/c5a0231449dd457b9f904f3c468f4d25/users/20264fc487b74bfcbaecbf5e4773307c/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:31.951025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5670c-aa70-49b2-ada2-fa9b2d432604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a0231449dd457b9f904f3c468f4d25, user_id=20264fc487b74bfcbaecbf5e4773307c, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:31.954683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5670c-aa70-49b2-ada2-fa9b2d432604 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:32.048561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1097/2176] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:31 2022] PUT /identity/v3/projects/c5a0231449dd457b9f904f3c468f4d25/users/20264fc487b74bfcbaecbf5e4773307c/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:32.049684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f2434-2521-4648-b7cd-d5fc33500e02 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:32.063250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f2434-2521-4648-b7cd-d5fc33500e02 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:32.135907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d72af3-5d51-41af-9803-01b96880af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:32.137590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d72af3-5d51-41af-9803-01b96880af28 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:32.137590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d72af3-5d51-41af-9803-01b96880af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:32.137590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d72af3-5d51-41af-9803-01b96880af28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:32.137871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d72af3-5d51-41af-9803-01b96880af28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:32.139494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d72af3-5d51-41af-9803-01b96880af28 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:32.152949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1080/2177] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:32.158146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5670c-aa70-49b2-ada2-fa9b2d432604 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:32.184543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5670c-aa70-49b2-ada2-fa9b2d432604 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:32.190146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d6c1f-96a6-4221-964f-a949601c6b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:32.191055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d6c1f-96a6-4221-964f-a949601c6b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:32.194806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d6c1f-96a6-4221-964f-a949601c6b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:32.194806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d6c1f-96a6-4221-964f-a949601c6b5e admin admin] PATH_INFO: `/v3/projects/c5a0231449dd457b9f904f3c468f4d25/users/20264fc487b74bfcbaecbf5e4773307c/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:32.194806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d6c1f-96a6-4221-964f-a949601c6b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a0231449dd457b9f904f3c468f4d25, user_id=20264fc487b74bfcbaecbf5e4773307c, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:32.196666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d6c1f-96a6-4221-964f-a949601c6b5e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:32.209213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1098/2178] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:32 2022] PUT /identity/v3/projects/c5a0231449dd457b9f904f3c468f4d25/users/20264fc487b74bfcbaecbf5e4773307c/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:32.220512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2fcd-2950-478f-81e5-762d9958d533 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:32.223254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2fcd-2950-478f-81e5-762d9958d533 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:32.223254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2fcd-2950-478f-81e5-762d9958d533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:32.284273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-075c2fcd-2950-478f-81e5-762d9958d533 None None] MFA Rules not processed for user `20264fc487b74bfcbaecbf5e4773307c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:32.284273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-075c2fcd-2950-478f-81e5-762d9958d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:32.366219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1081/2179] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:32.380747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d6c1f-96a6-4221-964f-a949601c6b5e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:32.381886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8d3d6c1f-96a6-4221-964f-a949601c6b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:32.459140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d6c1f-96a6-4221-964f-a949601c6b5e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:32.459140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bf114-cdc8-4b8e-aea3-3044dfe007cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:32.459140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bf114-cdc8-4b8e-aea3-3044dfe007cc service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:32.459140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bf114-cdc8-4b8e-aea3-3044dfe007cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:32.459476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bf114-cdc8-4b8e-aea3-3044dfe007cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:32.468460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bf114-cdc8-4b8e-aea3-3044dfe007cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:32.469923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bf114-cdc8-4b8e-aea3-3044dfe007cc service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:32.487211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1099/2180] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:32.662318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2fcd-2950-478f-81e5-762d9958d533 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:32.671931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2fcd-2950-478f-81e5-762d9958d533 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:32.675469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44a995-6e88-4e56-a3b6-ad360db598ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:32.676107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44a995-6e88-4e56-a3b6-ad360db598ad service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:32.676386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44a995-6e88-4e56-a3b6-ad360db598ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:32.676671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44a995-6e88-4e56-a3b6-ad360db598ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:32.740219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44a995-6e88-4e56-a3b6-ad360db598ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:32.741974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44a995-6e88-4e56-a3b6-ad360db598ad service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:32.754304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1082/2181] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:32.797622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:32.934910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:33.428512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bf114-cdc8-4b8e-aea3-3044dfe007cc service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:33.554583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bf114-cdc8-4b8e-aea3-3044dfe007cc service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:33.571442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:33.572530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.572933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.573311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] PATH_INFO: `/v3/users/8ba592ede7b448c18fc2e92b5de0c82e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.578214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba592ede7b448c18fc2e92b5de0c82e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:33.580490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:33.879763 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba592ede7b448c18fc2e92b5de0c82e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:33.880581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba592ede7b448c18fc2e92b5de0c82e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:33.881246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba592ede7b448c18fc2e92b5de0c82e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:33.906184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba592ede7b448c18fc2e92b5de0c82e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:33.914150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba592ede7b448c18fc2e92b5de0c82e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:33.944071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc3e6-af6e-4058-9f51-efe7e2adadfb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.945489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc3e6-af6e-4058-9f51-efe7e2adadfb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.945766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc3e6-af6e-4058-9f51-efe7e2adadfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.980726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f73fc3e6-af6e-4058-9f51-efe7e2adadfb None None] MFA Rules not processed for user `5a6e44ab0c394541a7d7b290928ea6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:33.981933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f73fc3e6-af6e-4058-9f51-efe7e2adadfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:34.034188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1100/2182] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:33 2022] DELETE /identity/v3/users/8ba592ede7b448c18fc2e92b5de0c82e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:34.037835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:34.042538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:34.089712 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1083/2183] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:34.097298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ffc03-7e93-4ec7-975b-9023ef4f6820 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:34.097298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ffc03-7e93-4ec7-975b-9023ef4f6820 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:34.097298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ffc03-7e93-4ec7-975b-9023ef4f6820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:34.117698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9c9ffc03-7e93-4ec7-975b-9023ef4f6820 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:34.119136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c9ffc03-7e93-4ec7-975b-9023ef4f6820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:34.137015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac524b-afd7-4ac3-a7e6-62406f0e4c53 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:34.141729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:34.142730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:34.144235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:34.144235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:34.146106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:34.200979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1084/2184] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:34.202109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ffc03-7e93-4ec7-975b-9023ef4f6820 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:34.203472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9c9ffc03-7e93-4ec7-975b-9023ef4f6820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:34.231435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:34.233085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:34.243873 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1101/2185] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:34.245159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:34.246315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:34.330675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744677d1-f270-4dd1-afbd-327ee2ff16d1 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:34.334457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616afdd2-89e0-4547-8978-5230cd747fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:34.335120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afdd2-89e0-4547-8978-5230cd747fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:34.335416 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afdd2-89e0-4547-8978-5230cd747fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:34.335720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afdd2-89e0-4547-8978-5230cd747fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:34.349230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616afdd2-89e0-4547-8978-5230cd747fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:34.350651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616afdd2-89e0-4547-8978-5230cd747fa5 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:34.357541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:34.361600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1102/2186] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:34.376544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ffc03-7e93-4ec7-975b-9023ef4f6820 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:34.376544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb3fc3-ebcd-4d97-87fd-883c2598f22f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:34.390286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb3fc3-ebcd-4d97-87fd-883c2598f22f service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:34.390602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb3fc3-ebcd-4d97-87fd-883c2598f22f service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:34.390852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb3fc3-ebcd-4d97-87fd-883c2598f22f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:34.453114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb3fc3-ebcd-4d97-87fd-883c2598f22f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:34.454788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb3fc3-ebcd-4d97-87fd-883c2598f22f service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:34.464778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1085/2187] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:34.545608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:34.861225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616afdd2-89e0-4547-8978-5230cd747fa5 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:34.862779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-616afdd2-89e0-4547-8978-5230cd747fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:34.877123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616afdd2-89e0-4547-8978-5230cd747fa5 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:34.881817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:34.882717 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:34.882935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:34.883281 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] PATH_INFO: `/v3/projects/26ca9af9796e47aebb2a35bc39b47472` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:34.884436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ca9af9796e47aebb2a35bc39b47472)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:34.886605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:35.035812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ca9af9796e47aebb2a35bc39b47472', 'request_id': 'req-a6179dfc-48fc-4712-af92-79aa51ece992'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.044137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ca9af9796e47aebb2a35bc39b47472', 'request_id': 'req-a6179dfc-48fc-4712-af92-79aa51ece992'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.132405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ca9af9796e47aebb2a35bc39b47472', 'request_id': 'req-a6179dfc-48fc-4712-af92-79aa51ece992'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.162536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] The token cache is being invalidate because project 26ca9af9796e47aebb2a35bc39b47472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:35.162832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.163708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.170078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1103/2188] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:34 2022] DELETE /identity/v3/projects/26ca9af9796e47aebb2a35bc39b47472 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:35.174410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb3fc3-ebcd-4d97-87fd-883c2598f22f service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:35.192338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb3fc3-ebcd-4d97-87fd-883c2598f22f service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:35.265117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:35.265851 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:35.266203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:35.266770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] PATH_INFO: `/v3/users/20264fc487b74bfcbaecbf5e4773307c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:35.268717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=20264fc487b74bfcbaecbf5e4773307c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:35.271591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:35.577402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20264fc487b74bfcbaecbf5e4773307c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.579523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20264fc487b74bfcbaecbf5e4773307c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.607043 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20264fc487b74bfcbaecbf5e4773307c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.616574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20264fc487b74bfcbaecbf5e4773307c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.617984 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1a45cc88-e0d8-4a22-a938-f7736083f8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20264fc487b74bfcbaecbf5e4773307c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:35.732253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1086/2189] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:35 2022] DELETE /identity/v3/users/20264fc487b74bfcbaecbf5e4773307c => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:36.213754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:36.215260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:36.238590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6179dfc-48fc-4712-af92-79aa51ece992 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:36.297598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:36.298495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:36.298906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:36.299231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] PATH_INFO: `/v3/projects/c5a0231449dd457b9f904f3c468f4d25` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:36.300406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a0231449dd457b9f904f3c468f4d25)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:36.302277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:36.351818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=10,keystone:SELECT=83,keystone:INSERT=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:36.512289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a0231449dd457b9f904f3c468f4d25', 'request_id': 'req-77a3674e-aa0e-42dc-b209-be4e510434b2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:36.518311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a0231449dd457b9f904f3c468f4d25', 'request_id': 'req-77a3674e-aa0e-42dc-b209-be4e510434b2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:36.603138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a0231449dd457b9f904f3c468f4d25', 'request_id': 'req-77a3674e-aa0e-42dc-b209-be4e510434b2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:36.617825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] The token cache is being invalidate because project c5a0231449dd457b9f904f3c468f4d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:36.618422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:36.620428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-77a3674e-aa0e-42dc-b209-be4e510434b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:36.623317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1104/2190] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:36 2022] DELETE /identity/v3/projects/c5a0231449dd457b9f904f3c468f4d25 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:36.627800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4f559-8660-48fa-a056-8c4bfed9b278 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:36.628303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4f559-8660-48fa-a056-8c4bfed9b278 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:36.628724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4f559-8660-48fa-a056-8c4bfed9b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:36.678804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-bca4f559-8660-48fa-a056-8c4bfed9b278 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:36.681081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bca4f559-8660-48fa-a056-8c4bfed9b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:36.769493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1087/2191] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:36.772381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:36.778016 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013dbd2-4959-49fd-9567-3c4f94996cdf None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:36.778386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013dbd2-4959-49fd-9567-3c4f94996cdf None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:36.783330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013dbd2-4959-49fd-9567-3c4f94996cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:36.829195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3013dbd2-4959-49fd-9567-3c4f94996cdf None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:36.833321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3013dbd2-4959-49fd-9567-3c4f94996cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:36.864610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1105/2192] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:36.870160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4f559-8660-48fa-a056-8c4bfed9b278 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:36.884706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4f559-8660-48fa-a056-8c4bfed9b278 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:36.886689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5c104-1984-42c4-a91a-6092f6fc244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:36.887437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5c104-1984-42c4-a91a-6092f6fc244f admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:36.887716 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5c104-1984-42c4-a91a-6092f6fc244f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:36.887991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5c104-1984-42c4-a91a-6092f6fc244f admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:36.888889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5c104-1984-42c4-a91a-6092f6fc244f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:36.889255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5c104-1984-42c4-a91a-6092f6fc244f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:36.890947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5c104-1984-42c4-a91a-6092f6fc244f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:36.914959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013dbd2-4959-49fd-9567-3c4f94996cdf None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:36.921626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1088/2193] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:36.926143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013dbd2-4959-49fd-9567-3c4f94996cdf None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:36.932808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de8acd-6774-414e-862d-e8ada4d607a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:36.934501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de8acd-6774-414e-862d-e8ada4d607a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:36.935225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de8acd-6774-414e-862d-e8ada4d607a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:36.935711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de8acd-6774-414e-862d-e8ada4d607a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:36.936631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de8acd-6774-414e-862d-e8ada4d607a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:36.938761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de8acd-6774-414e-862d-e8ada4d607a6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:37.030735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1106/2194] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:36 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:37.034911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5c104-1984-42c4-a91a-6092f6fc244f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:37.046729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5c104-1984-42c4-a91a-6092f6fc244f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:37.108803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3e7a-2d2c-4c04-baf6-70522222df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:37.109546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3e7a-2d2c-4c04-baf6-70522222df9b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:37.109827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3e7a-2d2c-4c04-baf6-70522222df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:37.110101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3e7a-2d2c-4c04-baf6-70522222df9b admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:37.110784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3e7a-2d2c-4c04-baf6-70522222df9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:37.112741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3e7a-2d2c-4c04-baf6-70522222df9b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:37.232131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1089/2195] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:37 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:37.236094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de8acd-6774-414e-862d-e8ada4d607a6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:37.261123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de8acd-6774-414e-862d-e8ada4d607a6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:37.270917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36dc2b-63ed-4299-aa9f-f0eb46908520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:37.271668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36dc2b-63ed-4299-aa9f-f0eb46908520 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:37.272592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36dc2b-63ed-4299-aa9f-f0eb46908520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:37.272872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36dc2b-63ed-4299-aa9f-f0eb46908520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:37.273629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36dc2b-63ed-4299-aa9f-f0eb46908520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:37.276734 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36dc2b-63ed-4299-aa9f-f0eb46908520 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:37.310638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3e7a-2d2c-4c04-baf6-70522222df9b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:37.311553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1107/2196] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:37.324657 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3e7a-2d2c-4c04-baf6-70522222df9b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:37.338857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f436e2f-79d4-4845-8d21-6d500185c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:37.339969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f436e2f-79d4-4845-8d21-6d500185c188 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:37.340616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f436e2f-79d4-4845-8d21-6d500185c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:37.340891 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f436e2f-79d4-4845-8d21-6d500185c188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:37.344310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f436e2f-79d4-4845-8d21-6d500185c188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:37.349258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f436e2f-79d4-4845-8d21-6d500185c188 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:37.361102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1090/2197] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:37.365109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36dc2b-63ed-4299-aa9f-f0eb46908520 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:37.391805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36dc2b-63ed-4299-aa9f-f0eb46908520 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:37.412975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa3a0-b09f-467e-bb66-4efa8efa145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:37.415514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa3a0-b09f-467e-bb66-4efa8efa145a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:37.416854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa3a0-b09f-467e-bb66-4efa8efa145a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:37.417702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa3a0-b09f-467e-bb66-4efa8efa145a admin admin] PATH_INFO: `/v3/projects/876fb1b08a5846998e8acef87b4fab48/users/a3c16173b3b249fa8f6295b93700ca4d/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:37.458106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aa3a0-b09f-467e-bb66-4efa8efa145a admin admin] RBAC: Authorizing `identity:create_grant(project_id=876fb1b08a5846998e8acef87b4fab48, user_id=a3c16173b3b249fa8f6295b93700ca4d, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:37.461987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aa3a0-b09f-467e-bb66-4efa8efa145a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:37.598121 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1108/2198] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:37 2022] PUT /identity/v3/projects/876fb1b08a5846998e8acef87b4fab48/users/a3c16173b3b249fa8f6295b93700ca4d/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:37.599939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd83d-1d17-4f9e-82f7-04d5e57c869b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:37.600229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd83d-1d17-4f9e-82f7-04d5e57c869b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:37.600893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cd83d-1d17-4f9e-82f7-04d5e57c869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:37.635614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a65cd83d-1d17-4f9e-82f7-04d5e57c869b None None] MFA Rules not processed for user `a3c16173b3b249fa8f6295b93700ca4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:37.636876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a65cd83d-1d17-4f9e-82f7-04d5e57c869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:37.716541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1091/2199] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:37.730039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa3a0-b09f-467e-bb66-4efa8efa145a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:37.731424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c6c62-065a-4f7a-8ed3-04268d67ed4f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:37.731703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c6c62-065a-4f7a-8ed3-04268d67ed4f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:37.732181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c6c62-065a-4f7a-8ed3-04268d67ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:37.754470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-904c6c62-065a-4f7a-8ed3-04268d67ed4f None None] MFA Rules not processed for user `5a6e44ab0c394541a7d7b290928ea6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:37.755773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-904c6c62-065a-4f7a-8ed3-04268d67ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:37.806350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa3a0-b09f-467e-bb66-4efa8efa145a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:37.813538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f580b07-ca58-4b53-b5f3-f269d50ecbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:37.814250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f580b07-ca58-4b53-b5f3-f269d50ecbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:37.814535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f580b07-ca58-4b53-b5f3-f269d50ecbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:37.814812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f580b07-ca58-4b53-b5f3-f269d50ecbcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:37.815600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f580b07-ca58-4b53-b5f3-f269d50ecbcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:37.817748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f580b07-ca58-4b53-b5f3-f269d50ecbcd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:37.828131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1092/2200] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:37.921925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1109/2201] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:37 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:37.926484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c6c62-065a-4f7a-8ed3-04268d67ed4f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:37.943594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c6c62-065a-4f7a-8ed3-04268d67ed4f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:37.971834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:38.010415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c453a0-b3c3-4beb-bba2-e5e8992bc9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:38.011137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c453a0-b3c3-4beb-bba2-e5e8992bc9dc admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:38.011423 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c453a0-b3c3-4beb-bba2-e5e8992bc9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:38.011696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c453a0-b3c3-4beb-bba2-e5e8992bc9dc admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:38.012549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c453a0-b3c3-4beb-bba2-e5e8992bc9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:38.014472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c453a0-b3c3-4beb-bba2-e5e8992bc9dc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:38.097688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1093/2202] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:37 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:38.102417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f580b07-ca58-4b53-b5f3-f269d50ecbcd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:38.120469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f580b07-ca58-4b53-b5f3-f269d50ecbcd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:38.126343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4da8ca-810d-4509-a112-c8d2090051ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:38.127033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da8ca-810d-4509-a112-c8d2090051ec admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:38.127345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da8ca-810d-4509-a112-c8d2090051ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:38.127636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da8ca-810d-4509-a112-c8d2090051ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:38.128360 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4da8ca-810d-4509-a112-c8d2090051ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:38.129969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4da8ca-810d-4509-a112-c8d2090051ec admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:38.149758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:38.152035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1110/2203] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:38.153283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c453a0-b3c3-4beb-bba2-e5e8992bc9dc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:38.169816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c453a0-b3c3-4beb-bba2-e5e8992bc9dc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:38.174941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a22c8-4c75-4297-b816-ee686e024526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:38.175787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a22c8-4c75-4297-b816-ee686e024526 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:38.176212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a22c8-4c75-4297-b816-ee686e024526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:38.176502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a22c8-4c75-4297-b816-ee686e024526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:38.177439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a22c8-4c75-4297-b816-ee686e024526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:38.179064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a22c8-4c75-4297-b816-ee686e024526 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:38.191169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1094/2204] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:38.194526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4da8ca-810d-4509-a112-c8d2090051ec admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:38.208448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4da8ca-810d-4509-a112-c8d2090051ec admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:38.214019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa626a-960a-4a2b-95bd-b971e5815c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:38.215027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa626a-960a-4a2b-95bd-b971e5815c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:38.215233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa626a-960a-4a2b-95bd-b971e5815c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:38.215474 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa626a-960a-4a2b-95bd-b971e5815c9a admin admin] PATH_INFO: `/v3/projects/b1b84d6fd02e4bfbad053ef6c1d2cad5/users/1c6190245cdd42e6a21ad478a36040c7/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:38.233299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa626a-960a-4a2b-95bd-b971e5815c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b84d6fd02e4bfbad053ef6c1d2cad5, user_id=1c6190245cdd42e6a21ad478a36040c7, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:38.236155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa626a-960a-4a2b-95bd-b971e5815c9a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:38.307416 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1111/2205] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:38 2022] PUT /identity/v3/projects/b1b84d6fd02e4bfbad053ef6c1d2cad5/users/1c6190245cdd42e6a21ad478a36040c7/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:38.318428 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431f5d2-3df4-4e97-9e3b-bae2392bafd9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:38.318684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431f5d2-3df4-4e97-9e3b-bae2392bafd9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:38.318923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431f5d2-3df4-4e97-9e3b-bae2392bafd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:38.359205 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5431f5d2-3df4-4e97-9e3b-bae2392bafd9 None None] MFA Rules not processed for user `1c6190245cdd42e6a21ad478a36040c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:38.360439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5431f5d2-3df4-4e97-9e3b-bae2392bafd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:38.450215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1095/2206] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:38.454075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa626a-960a-4a2b-95bd-b971e5815c9a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:38.527202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa626a-960a-4a2b-95bd-b971e5815c9a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:38.534490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c4833-d242-449d-be22-cc62a72c2643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:38.535382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c4833-d242-449d-be22-cc62a72c2643 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:38.535567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c4833-d242-449d-be22-cc62a72c2643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:38.535871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c4833-d242-449d-be22-cc62a72c2643 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:38.536516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c4833-d242-449d-be22-cc62a72c2643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:38.538414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c4833-d242-449d-be22-cc62a72c2643 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:38.644888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1112/2207] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:38 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:38.654546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431f5d2-3df4-4e97-9e3b-bae2392bafd9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:38.686849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431f5d2-3df4-4e97-9e3b-bae2392bafd9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:38.768428 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a645e-6534-4afe-bb37-0742a3b3617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:38.769106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a645e-6534-4afe-bb37-0742a3b3617e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:38.769426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a645e-6534-4afe-bb37-0742a3b3617e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:38.769699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a645e-6534-4afe-bb37-0742a3b3617e admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:38.770385 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a645e-6534-4afe-bb37-0742a3b3617e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:38.772486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a645e-6534-4afe-bb37-0742a3b3617e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:38.866209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1096/2208] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:38 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:38.870207 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c4833-d242-449d-be22-cc62a72c2643 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:38.882167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c4833-d242-449d-be22-cc62a72c2643 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:38.886275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe788f-6f4c-4b45-b5b2-aabf92cb31ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:38.887135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe788f-6f4c-4b45-b5b2-aabf92cb31ed admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:38.888626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe788f-6f4c-4b45-b5b2-aabf92cb31ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:38.888626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe788f-6f4c-4b45-b5b2-aabf92cb31ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:38.888626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe788f-6f4c-4b45-b5b2-aabf92cb31ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:38.890075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe788f-6f4c-4b45-b5b2-aabf92cb31ed admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:38.901179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1113/2209] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:38.905413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a645e-6534-4afe-bb37-0742a3b3617e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:38.917476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a645e-6534-4afe-bb37-0742a3b3617e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:38.923352 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d79807-8eab-4612-a9c4-0620a9326cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:38.924839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79807-8eab-4612-a9c4-0620a9326cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:38.925262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79807-8eab-4612-a9c4-0620a9326cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:38.925939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79807-8eab-4612-a9c4-0620a9326cc2 admin admin] PATH_INFO: `/v3/projects/fb76a0e5d64140fabc50c50ff3cab4bd/users/77545cff9ce84729ad0b98a9cfb8552d/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:38.958407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79807-8eab-4612-a9c4-0620a9326cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb76a0e5d64140fabc50c50ff3cab4bd, user_id=77545cff9ce84729ad0b98a9cfb8552d, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:38.961327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79807-8eab-4612-a9c4-0620a9326cc2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:39.029023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1097/2210] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:38 2022] PUT /identity/v3/projects/fb76a0e5d64140fabc50c50ff3cab4bd/users/77545cff9ce84729ad0b98a9cfb8552d/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:39.030218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe788f-6f4c-4b45-b5b2-aabf92cb31ed admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:39.041541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe788f-6f4c-4b45-b5b2-aabf92cb31ed admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:39.103540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e053e0-8c60-49ae-bf1d-a0b390cc9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:39.103540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e053e0-8c60-49ae-bf1d-a0b390cc9e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:39.103540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e053e0-8c60-49ae-bf1d-a0b390cc9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:39.103540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e053e0-8c60-49ae-bf1d-a0b390cc9e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:39.104031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e053e0-8c60-49ae-bf1d-a0b390cc9e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:39.104825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e053e0-8c60-49ae-bf1d-a0b390cc9e9a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:39.115073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1114/2211] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:39.120091 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d79807-8eab-4612-a9c4-0620a9326cc2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:39.130464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d79807-8eab-4612-a9c4-0620a9326cc2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:39.135974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1afd7-7db6-408e-8327-cf93597e3a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:39.136866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1afd7-7db6-408e-8327-cf93597e3a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:39.137149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1afd7-7db6-408e-8327-cf93597e3a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:39.137427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1afd7-7db6-408e-8327-cf93597e3a5a admin admin] PATH_INFO: `/v3/projects/fb76a0e5d64140fabc50c50ff3cab4bd/users/77545cff9ce84729ad0b98a9cfb8552d/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:39.139536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1afd7-7db6-408e-8327-cf93597e3a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb76a0e5d64140fabc50c50ff3cab4bd, user_id=77545cff9ce84729ad0b98a9cfb8552d, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:39.142170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1afd7-7db6-408e-8327-cf93597e3a5a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:39.153561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1098/2212] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:39 2022] PUT /identity/v3/projects/fb76a0e5d64140fabc50c50ff3cab4bd/users/77545cff9ce84729ad0b98a9cfb8552d/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:39.162989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:39.165869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f80e8-d101-4ac7-985a-bd73a19066a1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:39.165869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f80e8-d101-4ac7-985a-bd73a19066a1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:39.165869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f80e8-d101-4ac7-985a-bd73a19066a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:39.192050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-672f80e8-d101-4ac7-985a-bd73a19066a1 None None] MFA Rules not processed for user `77545cff9ce84729ad0b98a9cfb8552d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:39.193260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-672f80e8-d101-4ac7-985a-bd73a19066a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:39.214749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:39.262059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1115/2213] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:39.281796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1afd7-7db6-408e-8327-cf93597e3a5a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:39.283512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c8d1afd7-7db6-408e-8327-cf93597e3a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:39.344369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1afd7-7db6-408e-8327-cf93597e3a5a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:39.348156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f6e37-2fa6-4e88-b964-c5d5882126b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:39.348794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6e37-2fa6-4e88-b964-c5d5882126b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:39.349071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6e37-2fa6-4e88-b964-c5d5882126b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:39.349342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6e37-2fa6-4e88-b964-c5d5882126b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:39.418606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f6e37-2fa6-4e88-b964-c5d5882126b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:39.420073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f6e37-2fa6-4e88-b964-c5d5882126b0 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:39.429257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1099/2214] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:39.769354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:39.837293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:40.142268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:40.299964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:40.523066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:40.922679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:41.013964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:41.271767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:41.372007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:43.141962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f80e8-d101-4ac7-985a-bd73a19066a1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:43.143480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-672f80e8-d101-4ac7-985a-bd73a19066a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:43.165498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:43.211569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f80e8-d101-4ac7-985a-bd73a19066a1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:43.216240 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:43.217145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:43.217395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:43.217671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] PATH_INFO: `/v3/users/264e70534a654039929983893eef4d6e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:43.218863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264e70534a654039929983893eef4d6e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:43.220809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:43.418131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264e70534a654039929983893eef4d6e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:43.418765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264e70534a654039929983893eef4d6e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:43.419465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264e70534a654039929983893eef4d6e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:43.433771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264e70534a654039929983893eef4d6e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:43.441436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264e70534a654039929983893eef4d6e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:43.561560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1116/2215] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:43 2022] DELETE /identity/v3/users/264e70534a654039929983893eef4d6e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:43.564764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2fe3-648a-4309-bc12-daf5013f8f81 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:43.565257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2fe3-648a-4309-bc12-daf5013f8f81 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:43.565353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2fe3-648a-4309-bc12-daf5013f8f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:43.576983 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:43.578378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:43.585003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-334b2fe3-648a-4309-bc12-daf5013f8f81 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:43.586171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-334b2fe3-648a-4309-bc12-daf5013f8f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:43.639251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232ef7d-8b6f-4403-8f99-ae95a4b62b46 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:43.643549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:43.644194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:43.644469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:43.644738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:43.646569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:43.649868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1100/2216] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:43.665528 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2fe3-648a-4309-bc12-daf5013f8f81 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:43.667755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-334b2fe3-648a-4309-bc12-daf5013f8f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:43.694201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:43.706684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:43.708372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:43.719050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1117/2217] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:43.730668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2fe3-648a-4309-bc12-daf5013f8f81 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:43.734577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5c4b8-ccf9-491c-99f8-cca9c306d41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:43.735320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c4b8-ccf9-491c-99f8-cca9c306d41c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:43.735605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c4b8-ccf9-491c-99f8-cca9c306d41c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:43.739032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c4b8-ccf9-491c-99f8-cca9c306d41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:43.745756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5c4b8-ccf9-491c-99f8-cca9c306d41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:43.747283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5c4b8-ccf9-491c-99f8-cca9c306d41c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:43.757110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1101/2218] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:44.284711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:44.285211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:44.303500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1061255-2611-4d0c-9ea5-10002637529b service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:44.310306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:44.313158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:44.313158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:44.313158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] PATH_INFO: `/v3/projects/1e6454f8d2f14800b29c2ce42e6d4a83` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:44.313158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6454f8d2f14800b29c2ce42e6d4a83)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:44.316183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:44.443795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6454f8d2f14800b29c2ce42e6d4a83', 'request_id': 'req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:44.452500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6454f8d2f14800b29c2ce42e6d4a83', 'request_id': 'req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:44.537045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6454f8d2f14800b29c2ce42e6d4a83', 'request_id': 'req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:44.553918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] The token cache is being invalidate because project 1e6454f8d2f14800b29c2ce42e6d4a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:44.554208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:44.554868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eaac67d1-ce67-4afb-8d0c-a4c781e2540b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:44.559612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1118/2219] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:44 2022] DELETE /identity/v3/projects/1e6454f8d2f14800b29c2ce42e6d4a83 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:44.562418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82162c-ae96-4dd9-8eaf-73ba4c0b173c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:44.562976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82162c-ae96-4dd9-8eaf-73ba4c0b173c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:44.563321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82162c-ae96-4dd9-8eaf-73ba4c0b173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:44.583276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ad82162c-ae96-4dd9-8eaf-73ba4c0b173c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:44.584570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ad82162c-ae96-4dd9-8eaf-73ba4c0b173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:44.604382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:44.658374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1102/2220] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:44.666353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c13f6-7e09-4a1a-bff9-c470a4c0d727 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:44.666693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c13f6-7e09-4a1a-bff9-c470a4c0d727 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:44.667312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c13f6-7e09-4a1a-bff9-c470a4c0d727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:44.686777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f55c13f6-7e09-4a1a-bff9-c470a4c0d727 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:44.688006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f55c13f6-7e09-4a1a-bff9-c470a4c0d727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:44.696091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1119/2221] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:44.700335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82162c-ae96-4dd9-8eaf-73ba4c0b173c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:44.709999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82162c-ae96-4dd9-8eaf-73ba4c0b173c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:44.715621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41769fc-87ed-4ab7-8f5c-4ad14b859d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:44.716512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41769fc-87ed-4ab7-8f5c-4ad14b859d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:44.716930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41769fc-87ed-4ab7-8f5c-4ad14b859d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:44.717389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41769fc-87ed-4ab7-8f5c-4ad14b859d11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:44.718371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41769fc-87ed-4ab7-8f5c-4ad14b859d11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:44.719013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41769fc-87ed-4ab7-8f5c-4ad14b859d11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:44.724378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41769fc-87ed-4ab7-8f5c-4ad14b859d11 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:44.735032 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1103/2222] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:44.739465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c13f6-7e09-4a1a-bff9-c470a4c0d727 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:44.750075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c13f6-7e09-4a1a-bff9-c470a4c0d727 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:44.754944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1bb44-37e9-47e4-8c07-fc0971f7b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:44.755642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1bb44-37e9-47e4-8c07-fc0971f7b34f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:44.755924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1bb44-37e9-47e4-8c07-fc0971f7b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:44.756329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1bb44-37e9-47e4-8c07-fc0971f7b34f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:44.757061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1bb44-37e9-47e4-8c07-fc0971f7b34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:44.758924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1bb44-37e9-47e4-8c07-fc0971f7b34f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:44.848047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1120/2223] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:44 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:44.852451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41769fc-87ed-4ab7-8f5c-4ad14b859d11 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:44.863202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41769fc-87ed-4ab7-8f5c-4ad14b859d11 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:44.935027 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665d321-1401-44cd-ba57-a243af041a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:44.935766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665d321-1401-44cd-ba57-a243af041a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:44.936052 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665d321-1401-44cd-ba57-a243af041a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:44.936332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665d321-1401-44cd-ba57-a243af041a11 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:44.937024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665d321-1401-44cd-ba57-a243af041a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:44.938958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665d321-1401-44cd-ba57-a243af041a11 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:45.033606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1104/2224] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:44 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:45.038094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1bb44-37e9-47e4-8c07-fc0971f7b34f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:45.069247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1bb44-37e9-47e4-8c07-fc0971f7b34f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:45.074547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa440ac-780f-40f3-b30a-29e423467110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:45.075345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa440ac-780f-40f3-b30a-29e423467110 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:45.075590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa440ac-780f-40f3-b30a-29e423467110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:45.075867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa440ac-780f-40f3-b30a-29e423467110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:45.076599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa440ac-780f-40f3-b30a-29e423467110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:45.078232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa440ac-780f-40f3-b30a-29e423467110 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:45.091172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1121/2225] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:45.095118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665d321-1401-44cd-ba57-a243af041a11 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:45.105334 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665d321-1401-44cd-ba57-a243af041a11 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:45.110622 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ae8b9-24e2-4ea5-926f-8e5fe3d5c5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:45.111313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae8b9-24e2-4ea5-926f-8e5fe3d5c5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:45.111598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae8b9-24e2-4ea5-926f-8e5fe3d5c5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:45.112024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae8b9-24e2-4ea5-926f-8e5fe3d5c5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:45.112751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ae8b9-24e2-4ea5-926f-8e5fe3d5c5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:45.114373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ae8b9-24e2-4ea5-926f-8e5fe3d5c5b7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:45.129339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1105/2226] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:45.130880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa440ac-780f-40f3-b30a-29e423467110 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:45.145882 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa440ac-780f-40f3-b30a-29e423467110 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:45.151070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8c204-c2d0-4712-b620-46bc2b3efefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:45.152058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8c204-c2d0-4712-b620-46bc2b3efefd admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:45.152285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8c204-c2d0-4712-b620-46bc2b3efefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:45.152593 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8c204-c2d0-4712-b620-46bc2b3efefd admin admin] PATH_INFO: `/v3/projects/0fe7771afa3e4fb0a3fcfa8f328c1ebb/users/f4a690835f9143b096f00fceb47d4a10/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:45.169856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8c204-c2d0-4712-b620-46bc2b3efefd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe7771afa3e4fb0a3fcfa8f328c1ebb, user_id=f4a690835f9143b096f00fceb47d4a10, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:45.172668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8c204-c2d0-4712-b620-46bc2b3efefd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:45.286560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1122/2227] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:45 2022] PUT /identity/v3/projects/0fe7771afa3e4fb0a3fcfa8f328c1ebb/users/f4a690835f9143b096f00fceb47d4a10/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:45.292372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c64315-d1a2-45a8-ac2c-35add2c3c59e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:45.292660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c64315-d1a2-45a8-ac2c-35add2c3c59e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:45.293001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c64315-d1a2-45a8-ac2c-35add2c3c59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:45.313777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8c204-c2d0-4712-b620-46bc2b3efefd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:45.313777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-51b8c204-c2d0-4712-b620-46bc2b3efefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:45.322035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-48c64315-d1a2-45a8-ac2c-35add2c3c59e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:45.323502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-48c64315-d1a2-45a8-ac2c-35add2c3c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:45.488411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8c204-c2d0-4712-b620-46bc2b3efefd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:45.491951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1106/2228] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:45.493027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a405cc-0f73-4a28-9947-1ae4a058494b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:45.494732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a405cc-0f73-4a28-9947-1ae4a058494b service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:45.494732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a405cc-0f73-4a28-9947-1ae4a058494b service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:45.494732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a405cc-0f73-4a28-9947-1ae4a058494b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:45.497093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-04a405cc-0f73-4a28-9947-1ae4a058494b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:45.503233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c64315-d1a2-45a8-ac2c-35add2c3c59e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:45.504923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-48c64315-d1a2-45a8-ac2c-35add2c3c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:45.525404 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:45.548568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:45.580689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c64315-d1a2-45a8-ac2c-35add2c3c59e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:45.581877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a405cc-0f73-4a28-9947-1ae4a058494b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:45.583347 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a405cc-0f73-4a28-9947-1ae4a058494b service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:45.584669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919b1d0-1eb5-4b48-9985-15159ba570fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:45.585321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919b1d0-1eb5-4b48-9985-15159ba570fd service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:45.585606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919b1d0-1eb5-4b48-9985-15159ba570fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:45.585882 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919b1d0-1eb5-4b48-9985-15159ba570fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:45.594852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1123/2229] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:45.601845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919b1d0-1eb5-4b48-9985-15159ba570fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:45.602224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919b1d0-1eb5-4b48-9985-15159ba570fd service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:45.613685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1107/2230] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:51.402089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610ff9b-fc2a-4786-9efd-9bdfa0863ef8 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:51.402678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610ff9b-fc2a-4786-9efd-9bdfa0863ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:51.402678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610ff9b-fc2a-4786-9efd-9bdfa0863ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:51.462630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7610ff9b-fc2a-4786-9efd-9bdfa0863ef8 None None] MFA Rules not processed for user `f4a690835f9143b096f00fceb47d4a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:51.464038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7610ff9b-fc2a-4786-9efd-9bdfa0863ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:51.572921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1124/2231] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:51.578069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919b1d0-1eb5-4b48-9985-15159ba570fd service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:51.594556 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919b1d0-1eb5-4b48-9985-15159ba570fd service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:51.618199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2472987-f047-4537-8c60-e248bf904d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:51.620183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2472987-f047-4537-8c60-e248bf904d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:51.620633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2472987-f047-4537-8c60-e248bf904d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:51.621125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2472987-f047-4537-8c60-e248bf904d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:51.622297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2472987-f047-4537-8c60-e248bf904d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:51.626892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2472987-f047-4537-8c60-e248bf904d54 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:51.814487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1108/2232] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:51 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:51.815729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610ff9b-fc2a-4786-9efd-9bdfa0863ef8 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:51.843373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610ff9b-fc2a-4786-9efd-9bdfa0863ef8 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:51.934335 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7e383-072e-4fdc-8f4a-2e1e59b76ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:51.935629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7e383-072e-4fdc-8f4a-2e1e59b76ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:51.948699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7e383-072e-4fdc-8f4a-2e1e59b76ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:51.948699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7e383-072e-4fdc-8f4a-2e1e59b76ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:51.948699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7e383-072e-4fdc-8f4a-2e1e59b76ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:51.948699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7e383-072e-4fdc-8f4a-2e1e59b76ed2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:52.046566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1125/2233] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:51 2022] POST /identity/v3/users => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:52.050616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2472987-f047-4537-8c60-e248bf904d54 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:52.061468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2472987-f047-4537-8c60-e248bf904d54 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:52.067170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0528f6-ef94-49ff-a80f-598bbe13f28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:52.067837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0528f6-ef94-49ff-a80f-598bbe13f28b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:52.068122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0528f6-ef94-49ff-a80f-598bbe13f28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:52.068398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0528f6-ef94-49ff-a80f-598bbe13f28b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:52.069130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0528f6-ef94-49ff-a80f-598bbe13f28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:52.070748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0528f6-ef94-49ff-a80f-598bbe13f28b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:52.083473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1109/2234] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:52.087458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7e383-072e-4fdc-8f4a-2e1e59b76ed2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:52.098626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7e383-072e-4fdc-8f4a-2e1e59b76ed2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:52.103690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7a20-11f7-4850-8015-e14ecc3511df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:52.104952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7a20-11f7-4850-8015-e14ecc3511df admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:52.105236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7a20-11f7-4850-8015-e14ecc3511df admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:52.105510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e7a20-11f7-4850-8015-e14ecc3511df admin admin] PATH_INFO: `/v3/projects/872bc6a2f90541c88ecd90da7b56d568/users/405ba2af54df40b48138f488235bea9f/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:52.123084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e7a20-11f7-4850-8015-e14ecc3511df admin admin] RBAC: Authorizing `identity:create_grant(project_id=872bc6a2f90541c88ecd90da7b56d568, user_id=405ba2af54df40b48138f488235bea9f, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:52.125811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e7a20-11f7-4850-8015-e14ecc3511df admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:52.203533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1126/2235] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:52 2022] PUT /identity/v3/projects/872bc6a2f90541c88ecd90da7b56d568/users/405ba2af54df40b48138f488235bea9f/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:52.207615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0528f6-ef94-49ff-a80f-598bbe13f28b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:52.218109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0528f6-ef94-49ff-a80f-598bbe13f28b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:52.322946 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a36fc8-2a48-40e1-a48b-cd64015ba456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:52.323651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36fc8-2a48-40e1-a48b-cd64015ba456 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:52.324062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36fc8-2a48-40e1-a48b-cd64015ba456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:52.324372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36fc8-2a48-40e1-a48b-cd64015ba456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:52.325119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a36fc8-2a48-40e1-a48b-cd64015ba456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:52.326998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a36fc8-2a48-40e1-a48b-cd64015ba456 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:52.337341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1110/2236] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:52.342946 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7a20-11f7-4850-8015-e14ecc3511df admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:52.361381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e7a20-11f7-4850-8015-e14ecc3511df admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:52.364886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2522e4-f75d-4318-afaa-0e3f3e806451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:52.366141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2522e4-f75d-4318-afaa-0e3f3e806451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:52.366516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2522e4-f75d-4318-afaa-0e3f3e806451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:52.366798 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2522e4-f75d-4318-afaa-0e3f3e806451 admin admin] PATH_INFO: `/v3/projects/872bc6a2f90541c88ecd90da7b56d568/users/405ba2af54df40b48138f488235bea9f/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:52.368866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2522e4-f75d-4318-afaa-0e3f3e806451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872bc6a2f90541c88ecd90da7b56d568, user_id=405ba2af54df40b48138f488235bea9f, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:52.371842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2522e4-f75d-4318-afaa-0e3f3e806451 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:52.379364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:52.384896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1127/2237] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:52 2022] PUT /identity/v3/projects/872bc6a2f90541c88ecd90da7b56d568/users/405ba2af54df40b48138f488235bea9f/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:58.783747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f00b-faac-48d9-b4db-d290b8926ff9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:58.783747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f00b-faac-48d9-b4db-d290b8926ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:58.783747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f00b-faac-48d9-b4db-d290b8926ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:58.814387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dcf8f00b-faac-48d9-b4db-d290b8926ff9 None None] MFA Rules not processed for user `405ba2af54df40b48138f488235bea9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:58.815669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dcf8f00b-faac-48d9-b4db-d290b8926ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:58.894245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1111/2238] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:14:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:58.903221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2522e4-f75d-4318-afaa-0e3f3e806451 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:58.905661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8b2522e4-f75d-4318-afaa-0e3f3e806451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:58.987750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2522e4-f75d-4318-afaa-0e3f3e806451 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:58.991413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c2367-f12f-4b8b-921f-c8d988b4fe8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbc657ed3ae49dc9d45687c5dde2ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:58.992130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c2367-f12f-4b8b-921f-c8d988b4fe8d service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:58.992414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c2367-f12f-4b8b-921f-c8d988b4fe8d service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:59.000656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c2367-f12f-4b8b-921f-c8d988b4fe8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:59.062645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c2367-f12f-4b8b-921f-c8d988b4fe8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:59.064217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c2367-f12f-4b8b-921f-c8d988b4fe8d service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:59.074375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1128/2239] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:59.421264 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a291-a66d-4659-9255-8e2a7ff031df None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:59.421877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a291-a66d-4659-9255-8e2a7ff031df None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:59.422757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a291-a66d-4659-9255-8e2a7ff031df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:59.454687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9d67a291-a66d-4659-9255-8e2a7ff031df None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:59.456118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9d67a291-a66d-4659-9255-8e2a7ff031df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:59.472272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:59.519704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1112/2240] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:14:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:59.574813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c2367-f12f-4b8b-921f-c8d988b4fe8d service glance] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:59.576293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c67c2367-f12f-4b8b-921f-c8d988b4fe8d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:59.668208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c2367-f12f-4b8b-921f-c8d988b4fe8d service glance] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:59.673144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a23792-3525-4386-ab0d-833ae690e464 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:59.673790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a23792-3525-4386-ab0d-833ae690e464 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:59.674072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a23792-3525-4386-ab0d-833ae690e464 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:59.674343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a23792-3525-4386-ab0d-833ae690e464 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:59.682450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a23792-3525-4386-ab0d-833ae690e464 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:59.684113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a23792-3525-4386-ab0d-833ae690e464 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:59.692836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1129/2241] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:14:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:15:02.519959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a291-a66d-4659-9255-8e2a7ff031df None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:02.522995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9d67a291-a66d-4659-9255-8e2a7ff031df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:02.634966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a291-a66d-4659-9255-8e2a7ff031df None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:02.644707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:02.646485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:02.648418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:02.649288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] PATH_INFO: `/v3/users/a3c16173b3b249fa8f6295b93700ca4d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:02.653116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c16173b3b249fa8f6295b93700ca4d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:02.656657 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:02.892414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c16173b3b249fa8f6295b93700ca4d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:02.893307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c16173b3b249fa8f6295b93700ca4d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:02.923761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c16173b3b249fa8f6295b93700ca4d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:02.950130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c16173b3b249fa8f6295b93700ca4d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:02.950130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c16173b3b249fa8f6295b93700ca4d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:03.104645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1113/2242] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:02 2022] DELETE /identity/v3/users/a3c16173b3b249fa8f6295b93700ca4d => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:03.106336 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467342f-dfeb-44fb-b384-f5a52448dc1e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:03.106845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467342f-dfeb-44fb-b384-f5a52448dc1e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:03.107025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467342f-dfeb-44fb-b384-f5a52448dc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:03.158761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2467342f-dfeb-44fb-b384-f5a52448dc1e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:03.161002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2467342f-dfeb-44fb-b384-f5a52448dc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:03.238570 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:03.300656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1130/2243] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:03.311514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:03.313539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:03.404952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:03.424486 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac12f14-21cf-44d1-a3e3-fcaae500911e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:03.431178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f4daa-57f9-4475-9bee-4d8dddb35afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:03.432031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f4daa-57f9-4475-9bee-4d8dddb35afc service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:03.432944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f4daa-57f9-4475-9bee-4d8dddb35afc service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:03.434633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f4daa-57f9-4475-9bee-4d8dddb35afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:03.459169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f4daa-57f9-4475-9bee-4d8dddb35afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:03.459169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f4daa-57f9-4475-9bee-4d8dddb35afc service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:03.471986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1114/2244] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:04.208159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467342f-dfeb-44fb-b384-f5a52448dc1e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:04.209900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2467342f-dfeb-44fb-b384-f5a52448dc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:04.240997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467342f-dfeb-44fb-b384-f5a52448dc1e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:04.251958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:04.252959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:04.253339 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:04.253680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] PATH_INFO: `/v3/projects/876fb1b08a5846998e8acef87b4fab48` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:04.258723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=876fb1b08a5846998e8acef87b4fab48)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:04.262883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:04.477810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876fb1b08a5846998e8acef87b4fab48', 'request_id': 'req-d4568428-5bae-430f-99f1-f253c22fffc3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.488121 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876fb1b08a5846998e8acef87b4fab48', 'request_id': 'req-d4568428-5bae-430f-99f1-f253c22fffc3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.567952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876fb1b08a5846998e8acef87b4fab48', 'request_id': 'req-d4568428-5bae-430f-99f1-f253c22fffc3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.586501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] The token cache is being invalidate because project 876fb1b08a5846998e8acef87b4fab48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:04.587395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.588156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.592296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1131/2245] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:04 2022] DELETE /identity/v3/projects/876fb1b08a5846998e8acef87b4fab48 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:04.596585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f4daa-57f9-4475-9bee-4d8dddb35afc service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:04.606890 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f4daa-57f9-4475-9bee-4d8dddb35afc service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:04.692753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:04.693634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:04.693917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:04.694341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] PATH_INFO: `/v3/users/1c6190245cdd42e6a21ad478a36040c7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:04.695606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6190245cdd42e6a21ad478a36040c7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:04.697816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:04.887072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6190245cdd42e6a21ad478a36040c7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.887768 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6190245cdd42e6a21ad478a36040c7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.901369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6190245cdd42e6a21ad478a36040c7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.909763 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6190245cdd42e6a21ad478a36040c7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.910493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6190245cdd42e6a21ad478a36040c7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:04.993846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1115/2246] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:04 2022] DELETE /identity/v3/users/1c6190245cdd42e6a21ad478a36040c7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:05.586677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:05.588428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:05.696142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568428-5bae-430f-99f1-f253c22fffc3 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:05.765095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:05.765982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:05.766265 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:05.766538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] PATH_INFO: `/v3/projects/b1b84d6fd02e4bfbad053ef6c1d2cad5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:05.768184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b84d6fd02e4bfbad053ef6c1d2cad5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:05.770109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:05.780566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:05.907565 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b84d6fd02e4bfbad053ef6c1d2cad5', 'request_id': 'req-165bf035-e76e-42ee-a776-574bf1fe2726'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:05.914546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b84d6fd02e4bfbad053ef6c1d2cad5', 'request_id': 'req-165bf035-e76e-42ee-a776-574bf1fe2726'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:05.976584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b84d6fd02e4bfbad053ef6c1d2cad5', 'request_id': 'req-165bf035-e76e-42ee-a776-574bf1fe2726'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:05.989511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] The token cache is being invalidate because project b1b84d6fd02e4bfbad053ef6c1d2cad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:05.992552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:05.992552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:05.992716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1132/2247] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:05 2022] DELETE /identity/v3/projects/b1b84d6fd02e4bfbad053ef6c1d2cad5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:05.997500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:05.998953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:06.064203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92e3d6-4c85-468f-9cae-18669c22e8ef admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:06.085464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:06.127702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:06.128608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:06.128865 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:06.129140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] PATH_INFO: `/v3/users/77545cff9ce84729ad0b98a9cfb8552d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:06.130379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77545cff9ce84729ad0b98a9cfb8552d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:06.132307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:06.491992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77545cff9ce84729ad0b98a9cfb8552d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:06.492751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77545cff9ce84729ad0b98a9cfb8552d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:06.516555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77545cff9ce84729ad0b98a9cfb8552d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:06.527800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77545cff9ce84729ad0b98a9cfb8552d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:06.528998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c46330ab-7777-4122-a1a5-d98d605f4162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77545cff9ce84729ad0b98a9cfb8552d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:06.599699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1116/2248] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:05 2022] DELETE /identity/v3/users/77545cff9ce84729ad0b98a9cfb8552d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:07.376575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:07.376575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:07.390019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bf035-e76e-42ee-a776-574bf1fe2726 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:07.468145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:07.469120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:07.469472 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:07.469817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] PATH_INFO: `/v3/projects/fb76a0e5d64140fabc50c50ff3cab4bd` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:07.471085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb76a0e5d64140fabc50c50ff3cab4bd)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:07.476765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:07.592999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb76a0e5d64140fabc50c50ff3cab4bd', 'request_id': 'req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:07.600798 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb76a0e5d64140fabc50c50ff3cab4bd', 'request_id': 'req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:07.676811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb76a0e5d64140fabc50c50ff3cab4bd', 'request_id': 'req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:07.693063 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] The token cache is being invalidate because project fb76a0e5d64140fabc50c50ff3cab4bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:07.693378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:07.694012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a1398ca1-8f49-49b0-85fe-bb16fe0760c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:07.698989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1133/2249] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:07 2022] DELETE /identity/v3/projects/fb76a0e5d64140fabc50c50ff3cab4bd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:07.702648 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a2a9-2599-49a7-8bb8-a7890c1aec82 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:07.703215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a2a9-2599-49a7-8bb8-a7890c1aec82 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:07.703318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a2a9-2599-49a7-8bb8-a7890c1aec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:07.758740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d8f9a2a9-2599-49a7-8bb8-a7890c1aec82 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:07.760361 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d8f9a2a9-2599-49a7-8bb8-a7890c1aec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:07.847362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1117/2250] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:07.857759 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfc3b8-05da-4f1c-a7fe-6945ee8acf94 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:07.858041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfc3b8-05da-4f1c-a7fe-6945ee8acf94 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:07.858310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfc3b8-05da-4f1c-a7fe-6945ee8acf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:07.881131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4cbfc3b8-05da-4f1c-a7fe-6945ee8acf94 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:07.882323 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4cbfc3b8-05da-4f1c-a7fe-6945ee8acf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:07.891441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1134/2251] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:07.894776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a2a9-2599-49a7-8bb8-a7890c1aec82 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:07.905039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a2a9-2599-49a7-8bb8-a7890c1aec82 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:07.909993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b7cde-c784-42bd-b517-e915b32b1fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:07.910650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b7cde-c784-42bd-b517-e915b32b1fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:07.910936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b7cde-c784-42bd-b517-e915b32b1fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:07.911261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b7cde-c784-42bd-b517-e915b32b1fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:07.911986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b7cde-c784-42bd-b517-e915b32b1fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:15:07.912292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b7cde-c784-42bd-b517-e915b32b1fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:07.913868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b7cde-c784-42bd-b517-e915b32b1fe1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:07.928321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1118/2252] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:15:07.936986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfc3b8-05da-4f1c-a7fe-6945ee8acf94 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:07.946624 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfc3b8-05da-4f1c-a7fe-6945ee8acf94 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:07.954457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247ae30-fed6-490e-8c24-ae4c8e954074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:07.955202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ae30-fed6-490e-8c24-ae4c8e954074 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:07.955488 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ae30-fed6-490e-8c24-ae4c8e954074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:07.955768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ae30-fed6-490e-8c24-ae4c8e954074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:07.956471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247ae30-fed6-490e-8c24-ae4c8e954074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:07.958390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247ae30-fed6-490e-8c24-ae4c8e954074 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:08.043373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:08.051586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1135/2253] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:07 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:08.055873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b7cde-c784-42bd-b517-e915b32b1fe1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:08.067365 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b7cde-c784-42bd-b517-e915b32b1fe1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:08.072287 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:08.132673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0faee4-f5f6-4664-ab16-ef8fbfd01d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:08.134830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0faee4-f5f6-4664-ab16-ef8fbfd01d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:08.135585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0faee4-f5f6-4664-ab16-ef8fbfd01d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:08.135585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0faee4-f5f6-4664-ab16-ef8fbfd01d82 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:08.143926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0faee4-f5f6-4664-ab16-ef8fbfd01d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:08.150220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0faee4-f5f6-4664-ab16-ef8fbfd01d82 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:08.275021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1119/2254] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:08 2022] POST /identity/v3/users => generated 282 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:08.278283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247ae30-fed6-490e-8c24-ae4c8e954074 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:08.294947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247ae30-fed6-490e-8c24-ae4c8e954074 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:08.303759 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd45fd-4ef7-493e-8a99-c6f1de86947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:08.304527 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd45fd-4ef7-493e-8a99-c6f1de86947c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:08.308248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd45fd-4ef7-493e-8a99-c6f1de86947c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:08.308248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd45fd-4ef7-493e-8a99-c6f1de86947c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:08.308248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd45fd-4ef7-493e-8a99-c6f1de86947c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:08.308248 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd45fd-4ef7-493e-8a99-c6f1de86947c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:08.322451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1136/2255] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:08.323457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0faee4-f5f6-4664-ab16-ef8fbfd01d82 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:08.349762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0faee4-f5f6-4664-ab16-ef8fbfd01d82 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:08.362056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece4a29-ee2e-4ee9-b43e-4cbb9393a964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:08.362056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece4a29-ee2e-4ee9-b43e-4cbb9393a964 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:08.362056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece4a29-ee2e-4ee9-b43e-4cbb9393a964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:08.362056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece4a29-ee2e-4ee9-b43e-4cbb9393a964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:08.362371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece4a29-ee2e-4ee9-b43e-4cbb9393a964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:08.362371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece4a29-ee2e-4ee9-b43e-4cbb9393a964 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:08.372224 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1120/2256] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:08.376295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd45fd-4ef7-493e-8a99-c6f1de86947c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:08.397569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd45fd-4ef7-493e-8a99-c6f1de86947c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:08.405256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c40818-d5bb-469b-8c57-6d5f3213d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:08.406117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40818-d5bb-469b-8c57-6d5f3213d0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:08.406399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40818-d5bb-469b-8c57-6d5f3213d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:08.406807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40818-d5bb-469b-8c57-6d5f3213d0f6 admin admin] PATH_INFO: `/v3/projects/58d4f4f6743746a998c2a962b7126b23/users/18da5125d3b64a5e9f1e9e1d6f2374b6/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:08.425493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c40818-d5bb-469b-8c57-6d5f3213d0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d4f4f6743746a998c2a962b7126b23, user_id=18da5125d3b64a5e9f1e9e1d6f2374b6, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:08.428423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c40818-d5bb-469b-8c57-6d5f3213d0f6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:08.520495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1137/2257] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:08 2022] PUT /identity/v3/projects/58d4f4f6743746a998c2a962b7126b23/users/18da5125d3b64a5e9f1e9e1d6f2374b6/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:08.532870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f427a64-60dc-4e13-a40c-118c9ed2ffc8 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:08.534044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f427a64-60dc-4e13-a40c-118c9ed2ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:08.534326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f427a64-60dc-4e13-a40c-118c9ed2ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:08.566699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5f427a64-60dc-4e13-a40c-118c9ed2ffc8 None None] MFA Rules not processed for user `18da5125d3b64a5e9f1e9e1d6f2374b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:08.568223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5f427a64-60dc-4e13-a40c-118c9ed2ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:08.659247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1121/2258] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:08.673069 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c40818-d5bb-469b-8c57-6d5f3213d0f6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:08.675515 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-18c40818-d5bb-469b-8c57-6d5f3213d0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:08.778482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c40818-d5bb-469b-8c57-6d5f3213d0f6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:08.782318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549777b0-c2df-40f8-a180-252cdfb5564c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:08.783003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549777b0-c2df-40f8-a180-252cdfb5564c service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:08.783312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549777b0-c2df-40f8-a180-252cdfb5564c service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:08.783591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549777b0-c2df-40f8-a180-252cdfb5564c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:08.796437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549777b0-c2df-40f8-a180-252cdfb5564c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:08.797992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549777b0-c2df-40f8-a180-252cdfb5564c service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:08.808786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1138/2259] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:11.712544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816574e-81e5-43b3-aa98-ab12bbb1ddb9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:11.713053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816574e-81e5-43b3-aa98-ab12bbb1ddb9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:11.713273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816574e-81e5-43b3-aa98-ab12bbb1ddb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:11.732729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a816574e-81e5-43b3-aa98-ab12bbb1ddb9 None None] MFA Rules not processed for user `f4a690835f9143b096f00fceb47d4a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:11.733174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a816574e-81e5-43b3-aa98-ab12bbb1ddb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:11.794085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1122/2260] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:16.499874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549777b0-c2df-40f8-a180-252cdfb5564c service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:16.501319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-549777b0-c2df-40f8-a180-252cdfb5564c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:16.566997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549777b0-c2df-40f8-a180-252cdfb5564c service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:16.571880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:16.572754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:16.573034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:16.573307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] PATH_INFO: `/v3/users/c4c309516d49427bb679901ee30ba9c7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:16.574504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c309516d49427bb679901ee30ba9c7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:16.576448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:16.740848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c309516d49427bb679901ee30ba9c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:16.741499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c309516d49427bb679901ee30ba9c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:16.742098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c309516d49427bb679901ee30ba9c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:16.747067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:16.755446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c309516d49427bb679901ee30ba9c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:16.762058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c309516d49427bb679901ee30ba9c7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:16.830575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1139/2261] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:16 2022] DELETE /identity/v3/users/c4c309516d49427bb679901ee30ba9c7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:16.835976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029d9de-268a-437b-8ab2-2d60f8d3effc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:16.836459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029d9de-268a-437b-8ab2-2d60f8d3effc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:16.836761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029d9de-268a-437b-8ab2-2d60f8d3effc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:16.855319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8029d9de-268a-437b-8ab2-2d60f8d3effc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:16.856503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8029d9de-268a-437b-8ab2-2d60f8d3effc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:16.874295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:16.920322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1123/2262] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:16.930087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:16.931617 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:17.013294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcb65e-732f-496f-8267-69179cd0d23a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:17.016897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd765a11-504b-4c70-b832-7d94a0eb2fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:17.017823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765a11-504b-4c70-b832-7d94a0eb2fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:17.018107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765a11-504b-4c70-b832-7d94a0eb2fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:17.018377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765a11-504b-4c70-b832-7d94a0eb2fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:17.027231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd765a11-504b-4c70-b832-7d94a0eb2fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:17.028683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd765a11-504b-4c70-b832-7d94a0eb2fb7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:17.037947 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1140/2263] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:17.489824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029d9de-268a-437b-8ab2-2d60f8d3effc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:17.491506 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8029d9de-268a-437b-8ab2-2d60f8d3effc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:17.521875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029d9de-268a-437b-8ab2-2d60f8d3effc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:17.526909 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:17.527811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:17.528097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:17.528376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] PATH_INFO: `/v3/projects/bbfcbbbc08554a2cab083edefb1c1ec6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:17.529579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfcbbbc08554a2cab083edefb1c1ec6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:17.531542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:17.636052 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfcbbbc08554a2cab083edefb1c1ec6', 'request_id': 'req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:17.642753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfcbbbc08554a2cab083edefb1c1ec6', 'request_id': 'req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:17.721349 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfcbbbc08554a2cab083edefb1c1ec6', 'request_id': 'req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:17.732229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] The token cache is being invalidate because project bbfcbbbc08554a2cab083edefb1c1ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:17.732516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:17.733134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:17.734680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1124/2264] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:17 2022] DELETE /identity/v3/projects/bbfcbbbc08554a2cab083edefb1c1ec6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:17.738777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd765a11-504b-4c70-b832-7d94a0eb2fb7 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:17.749116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd765a11-504b-4c70-b832-7d94a0eb2fb7 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:17.805559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:17.805970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:17.806250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:17.806521 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] PATH_INFO: `/v3/users/349c82d142254414af7702d036e69a45` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:17.807999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349c82d142254414af7702d036e69a45)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:17.810197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:18.001936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349c82d142254414af7702d036e69a45'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.003073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349c82d142254414af7702d036e69a45'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.003342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349c82d142254414af7702d036e69a45'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.009239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:18.016749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349c82d142254414af7702d036e69a45'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.023507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2369738a-5d5b-403e-a707-17ad8263aee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349c82d142254414af7702d036e69a45'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.090157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1141/2265] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:17 2022] DELETE /identity/v3/users/349c82d142254414af7702d036e69a45 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:18.500047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:18.501552 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:18.515172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec82b3-5744-43fa-9ad1-1dee8ddc4a14 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:18.576294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:18.577059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:18.577341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:18.577619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] PATH_INFO: `/v3/projects/ea48e3de72e94d3e9f3a93d56db0904d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:18.578812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea48e3de72e94d3e9f3a93d56db0904d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:18.580753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:18.680417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:18.681733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea48e3de72e94d3e9f3a93d56db0904d', 'request_id': 'req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.688302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea48e3de72e94d3e9f3a93d56db0904d', 'request_id': 'req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.747869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea48e3de72e94d3e9f3a93d56db0904d', 'request_id': 'req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.759333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] The token cache is being invalidate because project ea48e3de72e94d3e9f3a93d56db0904d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:18.759621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.760270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4500bddc-884c-4dfe-a6d6-eb9f5bc33331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:18.761823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1125/2266] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:18 2022] DELETE /identity/v3/projects/ea48e3de72e94d3e9f3a93d56db0904d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:18.767628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba25788-a24d-475c-ae48-3f06c967b225 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:18.768110 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba25788-a24d-475c-ae48-3f06c967b225 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:18.768218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba25788-a24d-475c-ae48-3f06c967b225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:18.798205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7ba25788-a24d-475c-ae48-3f06c967b225 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:18.799449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7ba25788-a24d-475c-ae48-3f06c967b225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:18.864330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1142/2267] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:18.872064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472012f-5694-48d5-bbf7-104c09201cfc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:18.872349 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472012f-5694-48d5-bbf7-104c09201cfc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:18.872624 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472012f-5694-48d5-bbf7-104c09201cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:18.891086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3472012f-5694-48d5-bbf7-104c09201cfc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:18.892308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3472012f-5694-48d5-bbf7-104c09201cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:18.900398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1126/2268] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:18.905141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba25788-a24d-475c-ae48-3f06c967b225 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:18.915220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba25788-a24d-475c-ae48-3f06c967b225 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:18.919825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7e87a-4e68-4429-9a5e-0689fad4dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:18.920478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7e87a-4e68-4429-9a5e-0689fad4dce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:18.920762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7e87a-4e68-4429-9a5e-0689fad4dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:18.921038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7e87a-4e68-4429-9a5e-0689fad4dce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:18.921754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7e87a-4e68-4429-9a5e-0689fad4dce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:15:18.922061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7e87a-4e68-4429-9a5e-0689fad4dce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:18.923701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7e87a-4e68-4429-9a5e-0689fad4dce9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:18.935151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1143/2269] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:15:18.939391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472012f-5694-48d5-bbf7-104c09201cfc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:18.948508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472012f-5694-48d5-bbf7-104c09201cfc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:18.953620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50c315-dcef-4d58-a952-382b35c60929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:18.954256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50c315-dcef-4d58-a952-382b35c60929 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:18.954543 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50c315-dcef-4d58-a952-382b35c60929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:18.954815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50c315-dcef-4d58-a952-382b35c60929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:18.955523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50c315-dcef-4d58-a952-382b35c60929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:18.957404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50c315-dcef-4d58-a952-382b35c60929 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:19.065367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1127/2270] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:18 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:19.069457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7e87a-4e68-4429-9a5e-0689fad4dce9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:19.080505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7e87a-4e68-4429-9a5e-0689fad4dce9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:19.136312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9feeb-9c39-4d12-bfe0-7d02de65e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:19.136992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9feeb-9c39-4d12-bfe0-7d02de65e98e admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:19.137764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9feeb-9c39-4d12-bfe0-7d02de65e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:19.138038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9feeb-9c39-4d12-bfe0-7d02de65e98e admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:19.138732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9feeb-9c39-4d12-bfe0-7d02de65e98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:19.141015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9feeb-9c39-4d12-bfe0-7d02de65e98e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:19.213337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1144/2271] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:19 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:15:19.217821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50c315-dcef-4d58-a952-382b35c60929 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:19.228228 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50c315-dcef-4d58-a952-382b35c60929 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:19.232881 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3d76c-9bbe-4149-81c4-634750641266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:19.233536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3d76c-9bbe-4149-81c4-634750641266 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:19.233822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3d76c-9bbe-4149-81c4-634750641266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:19.234100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3d76c-9bbe-4149-81c4-634750641266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:19.234825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3d76c-9bbe-4149-81c4-634750641266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:19.236463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3d76c-9bbe-4149-81c4-634750641266 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:19.247817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1128/2272] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:19.251767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9feeb-9c39-4d12-bfe0-7d02de65e98e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:19.262688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9feeb-9c39-4d12-bfe0-7d02de65e98e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:19.267789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0401b4e-9c56-4bc0-bfda-55b6aca54e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:19.268458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0401b4e-9c56-4bc0-bfda-55b6aca54e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:19.268736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0401b4e-9c56-4bc0-bfda-55b6aca54e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:19.269009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0401b4e-9c56-4bc0-bfda-55b6aca54e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:19.269762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0401b4e-9c56-4bc0-bfda-55b6aca54e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:19.271354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0401b4e-9c56-4bc0-bfda-55b6aca54e0e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:19.281729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1145/2273] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:19.286050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3d76c-9bbe-4149-81c4-634750641266 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:19.296036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3d76c-9bbe-4149-81c4-634750641266 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:19.300631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a594832-2ca8-4f44-b250-0a6c52e30dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:19.301501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a594832-2ca8-4f44-b250-0a6c52e30dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:19.301781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a594832-2ca8-4f44-b250-0a6c52e30dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:19.302053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a594832-2ca8-4f44-b250-0a6c52e30dcd admin admin] PATH_INFO: `/v3/projects/1ca68a52e380483681261ea86a8a0449/users/2eb3129c64184fe197b9eec8aefece47/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:19.316713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a594832-2ca8-4f44-b250-0a6c52e30dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca68a52e380483681261ea86a8a0449, user_id=2eb3129c64184fe197b9eec8aefece47, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:19.319370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a594832-2ca8-4f44-b250-0a6c52e30dcd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:19.393573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1129/2274] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:19 2022] PUT /identity/v3/projects/1ca68a52e380483681261ea86a8a0449/users/2eb3129c64184fe197b9eec8aefece47/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:19.404469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655f324-35b2-43a4-84a9-8d3b0b0bff16 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:19.404756 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655f324-35b2-43a4-84a9-8d3b0b0bff16 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:19.405031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655f324-35b2-43a4-84a9-8d3b0b0bff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:19.431052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a655f324-35b2-43a4-84a9-8d3b0b0bff16 None None] MFA Rules not processed for user `2eb3129c64184fe197b9eec8aefece47`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:19.432365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a655f324-35b2-43a4-84a9-8d3b0b0bff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:19.449442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:19.496170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1146/2275] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:19.501431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a594832-2ca8-4f44-b250-0a6c52e30dcd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:19.562306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a594832-2ca8-4f44-b250-0a6c52e30dcd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:19.566877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f866ca1-99d9-4bd5-98fe-95b2348ac177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:19.567555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f866ca1-99d9-4bd5-98fe-95b2348ac177 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:19.567831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f866ca1-99d9-4bd5-98fe-95b2348ac177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:19.568098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f866ca1-99d9-4bd5-98fe-95b2348ac177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:19.568774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f866ca1-99d9-4bd5-98fe-95b2348ac177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:19.570652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f866ca1-99d9-4bd5-98fe-95b2348ac177 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:19.674588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1130/2276] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:19 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:19.678514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655f324-35b2-43a4-84a9-8d3b0b0bff16 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:19.689655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655f324-35b2-43a4-84a9-8d3b0b0bff16 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:19.748052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d9b7-d1c3-412b-9c62-2efc3f6c901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:19.748740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d9b7-d1c3-412b-9c62-2efc3f6c901d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:19.749022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d9b7-d1c3-412b-9c62-2efc3f6c901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:19.749298 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d9b7-d1c3-412b-9c62-2efc3f6c901d admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:19.750008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42d9b7-d1c3-412b-9c62-2efc3f6c901d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:19.752239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42d9b7-d1c3-412b-9c62-2efc3f6c901d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:19.843028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1147/2277] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:19 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:19.846102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f866ca1-99d9-4bd5-98fe-95b2348ac177 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:19.857775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f866ca1-99d9-4bd5-98fe-95b2348ac177 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:19.866245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cad3c6-b942-44e3-b107-946ab2a86a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:19.866771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cad3c6-b942-44e3-b107-946ab2a86a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:19.867059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cad3c6-b942-44e3-b107-946ab2a86a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:19.867481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cad3c6-b942-44e3-b107-946ab2a86a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:19.868089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cad3c6-b942-44e3-b107-946ab2a86a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:19.869938 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cad3c6-b942-44e3-b107-946ab2a86a32 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:19.887392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1131/2278] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:19.888177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d9b7-d1c3-412b-9c62-2efc3f6c901d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:19.898100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d9b7-d1c3-412b-9c62-2efc3f6c901d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:19.902721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75353a28-74c6-4218-b472-b5bf3745b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:19.903629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75353a28-74c6-4218-b472-b5bf3745b9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:19.903912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75353a28-74c6-4218-b472-b5bf3745b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:19.904180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75353a28-74c6-4218-b472-b5bf3745b9aa admin admin] PATH_INFO: `/v3/projects/26473da3af414f598a724215ac2ef2ec/users/13e30dc3f93a4320aa8ad4dce154c3f6/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:19.919232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75353a28-74c6-4218-b472-b5bf3745b9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=26473da3af414f598a724215ac2ef2ec, user_id=13e30dc3f93a4320aa8ad4dce154c3f6, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:19.921825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75353a28-74c6-4218-b472-b5bf3745b9aa admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:19.995677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1148/2279] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:19 2022] PUT /identity/v3/projects/26473da3af414f598a724215ac2ef2ec/users/13e30dc3f93a4320aa8ad4dce154c3f6/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:15:19.999497 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cad3c6-b942-44e3-b107-946ab2a86a32 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:20.009488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cad3c6-b942-44e3-b107-946ab2a86a32 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:20.052784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:20.064855 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe22fb-fb3c-47b3-ae7e-999e93c7e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:20.065510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe22fb-fb3c-47b3-ae7e-999e93c7e205 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:20.065791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe22fb-fb3c-47b3-ae7e-999e93c7e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:20.066065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe22fb-fb3c-47b3-ae7e-999e93c7e205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:20.066776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe22fb-fb3c-47b3-ae7e-999e93c7e205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:20.068416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe22fb-fb3c-47b3-ae7e-999e93c7e205 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:20.078105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1132/2280] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:20.081820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75353a28-74c6-4218-b472-b5bf3745b9aa admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:20.092568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75353a28-74c6-4218-b472-b5bf3745b9aa admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:20.097195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77190c-83ec-41a0-8bc1-90c5b2c928b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:20.098067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77190c-83ec-41a0-8bc1-90c5b2c928b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:20.098349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77190c-83ec-41a0-8bc1-90c5b2c928b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:20.098621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77190c-83ec-41a0-8bc1-90c5b2c928b6 admin admin] PATH_INFO: `/v3/projects/26473da3af414f598a724215ac2ef2ec/users/13e30dc3f93a4320aa8ad4dce154c3f6/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:20.100631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77190c-83ec-41a0-8bc1-90c5b2c928b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26473da3af414f598a724215ac2ef2ec, user_id=13e30dc3f93a4320aa8ad4dce154c3f6, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:20.103272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77190c-83ec-41a0-8bc1-90c5b2c928b6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:20.122542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1149/2281] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:20 2022] PUT /identity/v3/projects/26473da3af414f598a724215ac2ef2ec/users/13e30dc3f93a4320aa8ad4dce154c3f6/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:20.130245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebd8c7-8087-4953-9686-c0b824846e66 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:20.130525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebd8c7-8087-4953-9686-c0b824846e66 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:20.130801 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebd8c7-8087-4953-9686-c0b824846e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:20.157551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-caebd8c7-8087-4953-9686-c0b824846e66 None None] MFA Rules not processed for user `13e30dc3f93a4320aa8ad4dce154c3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:20.158878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-caebd8c7-8087-4953-9686-c0b824846e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:20.260542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1133/2282] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:20.270176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77190c-83ec-41a0-8bc1-90c5b2c928b6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:20.271740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4a77190c-83ec-41a0-8bc1-90c5b2c928b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:20.327736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77190c-83ec-41a0-8bc1-90c5b2c928b6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:20.331367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68515d66-63d7-4427-912d-dbe10567912d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:20.332004 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68515d66-63d7-4427-912d-dbe10567912d service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:20.332342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68515d66-63d7-4427-912d-dbe10567912d service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:20.332589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68515d66-63d7-4427-912d-dbe10567912d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:20.342246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68515d66-63d7-4427-912d-dbe10567912d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:20.343701 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68515d66-63d7-4427-912d-dbe10567912d service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:20.353259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1150/2283] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:20.449338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebd8c7-8087-4953-9686-c0b824846e66 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:20.459756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebd8c7-8087-4953-9686-c0b824846e66 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:20.463346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a011de2-2fa3-4cc2-94ac-90ee508b76a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:20.463974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a011de2-2fa3-4cc2-94ac-90ee508b76a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:20.464256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a011de2-2fa3-4cc2-94ac-90ee508b76a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:20.464523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a011de2-2fa3-4cc2-94ac-90ee508b76a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:20.521374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a011de2-2fa3-4cc2-94ac-90ee508b76a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:20.522732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a011de2-2fa3-4cc2-94ac-90ee508b76a5 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:20.532202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1134/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:21.407663 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4dc9d-1959-4208-9d68-c2786d320725 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:21.408140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4dc9d-1959-4208-9d68-c2786d320725 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:21.409102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4dc9d-1959-4208-9d68-c2786d320725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:21.443857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:21.452083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-73e4dc9d-1959-4208-9d68-c2786d320725 None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:21.453290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-73e4dc9d-1959-4208-9d68-c2786d320725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:21.516103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1151/2285] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:21.537709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a011de2-2fa3-4cc2-94ac-90ee508b76a5 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:21.544221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a011de2-2fa3-4cc2-94ac-90ee508b76a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:21.667426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a011de2-2fa3-4cc2-94ac-90ee508b76a5 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:21.674294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584bbbf-8745-4930-89de-ab100da55dce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:21.675492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584bbbf-8745-4930-89de-ab100da55dce service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:21.675780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584bbbf-8745-4930-89de-ab100da55dce service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:21.676048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584bbbf-8745-4930-89de-ab100da55dce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:21.684871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:21.688136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584bbbf-8745-4930-89de-ab100da55dce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:21.689919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584bbbf-8745-4930-89de-ab100da55dce service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:21.700349 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1135/2286] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:15:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:15:24.905619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4dc9d-1959-4208-9d68-c2786d320725 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:25.026139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4dc9d-1959-4208-9d68-c2786d320725 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:25.034047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:25.035023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:25.035339 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:25.035689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] PATH_INFO: `/v3/users/2eb3129c64184fe197b9eec8aefece47` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:25.038167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb3129c64184fe197b9eec8aefece47)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:25.040240 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:25.235884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb3129c64184fe197b9eec8aefece47'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:25.236708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb3129c64184fe197b9eec8aefece47'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:25.237488 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb3129c64184fe197b9eec8aefece47'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:25.267856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb3129c64184fe197b9eec8aefece47'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:25.275752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb3129c64184fe197b9eec8aefece47'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:25.382231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1152/2287] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:24 2022] DELETE /identity/v3/users/2eb3129c64184fe197b9eec8aefece47 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:25.387894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9ad26-2bcb-4c96-a012-2953bd38dc0e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:25.391493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9ad26-2bcb-4c96-a012-2953bd38dc0e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:25.391493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9ad26-2bcb-4c96-a012-2953bd38dc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:25.407941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-13b9ad26-2bcb-4c96-a012-2953bd38dc0e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:25.410484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-13b9ad26-2bcb-4c96-a012-2953bd38dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:25.473942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1136/2288] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:15:25.483420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:25.484897 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:25.519012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:25.543448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87328e0-66b9-4c84-814c-a994d680ee8e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:25.547197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf8cd8-0924-465d-86bf-16a1847f9d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:25.547844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf8cd8-0924-465d-86bf-16a1847f9d01 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:25.548127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf8cd8-0924-465d-86bf-16a1847f9d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:25.548400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf8cd8-0924-465d-86bf-16a1847f9d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:25.557285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf8cd8-0924-465d-86bf-16a1847f9d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:25.559365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf8cd8-0924-465d-86bf-16a1847f9d01 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:25.568746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1153/2289] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:25.980202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9ad26-2bcb-4c96-a012-2953bd38dc0e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:25.982262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-13b9ad26-2bcb-4c96-a012-2953bd38dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:25.996313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9ad26-2bcb-4c96-a012-2953bd38dc0e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:26.001164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:26.002064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:26.002343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:26.002616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] PATH_INFO: `/v3/projects/1ca68a52e380483681261ea86a8a0449` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:26.003814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca68a52e380483681261ea86a8a0449)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:26.005978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:26.128527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca68a52e380483681261ea86a8a0449', 'request_id': 'req-29bd2dce-6c38-438f-a273-a38b14ef2ddf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.134625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca68a52e380483681261ea86a8a0449', 'request_id': 'req-29bd2dce-6c38-438f-a273-a38b14ef2ddf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.207335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca68a52e380483681261ea86a8a0449', 'request_id': 'req-29bd2dce-6c38-438f-a273-a38b14ef2ddf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.222513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] The token cache is being invalidate because project 1ca68a52e380483681261ea86a8a0449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:26.222871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.223930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.229072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1137/2290] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:25 2022] DELETE /identity/v3/projects/1ca68a52e380483681261ea86a8a0449 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:26.229562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf8cd8-0924-465d-86bf-16a1847f9d01 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:26.240421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf8cd8-0924-465d-86bf-16a1847f9d01 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:26.318639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:26.319795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:26.324349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:26.324349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] PATH_INFO: `/v3/users/13e30dc3f93a4320aa8ad4dce154c3f6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:26.324349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e30dc3f93a4320aa8ad4dce154c3f6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:26.324349 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:26.540600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e30dc3f93a4320aa8ad4dce154c3f6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.543146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e30dc3f93a4320aa8ad4dce154c3f6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.543146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e30dc3f93a4320aa8ad4dce154c3f6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.559379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e30dc3f93a4320aa8ad4dce154c3f6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.566992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f6c6eb50-4019-42ea-9e4e-94f8e81c2c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e30dc3f93a4320aa8ad4dce154c3f6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:26.645508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1154/2291] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:26 2022] DELETE /identity/v3/users/13e30dc3f93a4320aa8ad4dce154c3f6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:27.048732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:27.050405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:27.065715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd2dce-6c38-438f-a273-a38b14ef2ddf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:27.124135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:27.125247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.125537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.125812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] PATH_INFO: `/v3/projects/26473da3af414f598a724215ac2ef2ec` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:27.126997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26473da3af414f598a724215ac2ef2ec)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:27.128924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:27.151328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:27.223708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26473da3af414f598a724215ac2ef2ec', 'request_id': 'req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:27.229701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26473da3af414f598a724215ac2ef2ec', 'request_id': 'req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:27.296067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26473da3af414f598a724215ac2ef2ec', 'request_id': 'req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:27.306637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] The token cache is being invalidate because project 26473da3af414f598a724215ac2ef2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:27.306920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:27.307559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-53f9b0ae-7d2a-4e14-a2b6-839cfea96a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:27.309785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1138/2292] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:27 2022] DELETE /identity/v3/projects/26473da3af414f598a724215ac2ef2ec => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:27.314604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3852f3-4ef4-407e-a253-67b6c3495eea None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.315085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3852f3-4ef4-407e-a253-67b6c3495eea None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.315205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3852f3-4ef4-407e-a253-67b6c3495eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:27.333483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8d3852f3-4ef4-407e-a253-67b6c3495eea None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:27.334637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8d3852f3-4ef4-407e-a253-67b6c3495eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:27.383484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:27.398004 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1155/2293] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:27.405861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08787db1-d1c3-4549-a095-e9594ce338bb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.406233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08787db1-d1c3-4549-a095-e9594ce338bb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.406698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08787db1-d1c3-4549-a095-e9594ce338bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:27.425868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-08787db1-d1c3-4549-a095-e9594ce338bb None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:27.427178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-08787db1-d1c3-4549-a095-e9594ce338bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:27.435877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1139/2294] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:27.440177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3852f3-4ef4-407e-a253-67b6c3495eea None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:27.449927 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3852f3-4ef4-407e-a253-67b6c3495eea None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:27.455482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b5a46-9067-4807-bb1d-76f809c8be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:27.456253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b5a46-9067-4807-bb1d-76f809c8be59 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.456535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b5a46-9067-4807-bb1d-76f809c8be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.456857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b5a46-9067-4807-bb1d-76f809c8be59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:27.457580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b5a46-9067-4807-bb1d-76f809c8be59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:15:27.457889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b5a46-9067-4807-bb1d-76f809c8be59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:27.459629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b5a46-9067-4807-bb1d-76f809c8be59 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:27.473256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1156/2295] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:15:27.483191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08787db1-d1c3-4549-a095-e9594ce338bb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:27.494481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08787db1-d1c3-4549-a095-e9594ce338bb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:27.499266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df896a-cbed-4c35-9304-961227c0f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:27.500031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df896a-cbed-4c35-9304-961227c0f172 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.500373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df896a-cbed-4c35-9304-961227c0f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.500713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df896a-cbed-4c35-9304-961227c0f172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:27.501459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df896a-cbed-4c35-9304-961227c0f172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:27.503536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df896a-cbed-4c35-9304-961227c0f172 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:27.622236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1140/2296] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:27 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:27.623457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b5a46-9067-4807-bb1d-76f809c8be59 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:27.633586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b5a46-9067-4807-bb1d-76f809c8be59 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:27.691905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fb6e3-8885-4ae4-89b0-cf67ae6086e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:27.692578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fb6e3-8885-4ae4-89b0-cf67ae6086e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.692863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fb6e3-8885-4ae4-89b0-cf67ae6086e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.693138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fb6e3-8885-4ae4-89b0-cf67ae6086e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:27.693839 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fb6e3-8885-4ae4-89b0-cf67ae6086e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:27.695778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fb6e3-8885-4ae4-89b0-cf67ae6086e8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:27.782306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1157/2297] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:27 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:15:27.786391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df896a-cbed-4c35-9304-961227c0f172 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:27.797139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df896a-cbed-4c35-9304-961227c0f172 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:27.802022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55f595-6710-4a2f-9724-abd5882d00f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:27.802673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55f595-6710-4a2f-9724-abd5882d00f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.802950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55f595-6710-4a2f-9724-abd5882d00f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.803260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55f595-6710-4a2f-9724-abd5882d00f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:27.803985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55f595-6710-4a2f-9724-abd5882d00f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:27.805546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55f595-6710-4a2f-9724-abd5882d00f7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:27.815828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1141/2298] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:27.819562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fb6e3-8885-4ae4-89b0-cf67ae6086e8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:27.829056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fb6e3-8885-4ae4-89b0-cf67ae6086e8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:27.833656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286026c1-7d31-43af-a81c-f5948dc3316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:27.834294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286026c1-7d31-43af-a81c-f5948dc3316f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.834569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286026c1-7d31-43af-a81c-f5948dc3316f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.834837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286026c1-7d31-43af-a81c-f5948dc3316f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:27.835581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286026c1-7d31-43af-a81c-f5948dc3316f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:27.837128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286026c1-7d31-43af-a81c-f5948dc3316f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:27.850487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1158/2299] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:27.851653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55f595-6710-4a2f-9724-abd5882d00f7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:27.862721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55f595-6710-4a2f-9724-abd5882d00f7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:27.867308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c602b-2627-447c-a82d-5e6e7eebaf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:27.868175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c602b-2627-447c-a82d-5e6e7eebaf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.868456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c602b-2627-447c-a82d-5e6e7eebaf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.868980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c602b-2627-447c-a82d-5e6e7eebaf31 admin admin] PATH_INFO: `/v3/projects/60f2fcc90e7c4f10aded1ce3a8e86999/users/9c6163500b1b426a95adb05e2151b51c/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:27.884652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c602b-2627-447c-a82d-5e6e7eebaf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f2fcc90e7c4f10aded1ce3a8e86999, user_id=9c6163500b1b426a95adb05e2151b51c, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:27.887880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c602b-2627-447c-a82d-5e6e7eebaf31 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:27.984300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1142/2300] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:27 2022] PUT /identity/v3/projects/60f2fcc90e7c4f10aded1ce3a8e86999/users/9c6163500b1b426a95adb05e2151b51c/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:27.995757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4134406-cd05-4e25-ab1e-4f60bb38d580 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:27.996047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4134406-cd05-4e25-ab1e-4f60bb38d580 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:27.996350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4134406-cd05-4e25-ab1e-4f60bb38d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:28.025719 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e4134406-cd05-4e25-ab1e-4f60bb38d580 None None] MFA Rules not processed for user `9c6163500b1b426a95adb05e2151b51c`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:28.026917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e4134406-cd05-4e25-ab1e-4f60bb38d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:28.103816 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1159/2301] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:28.108366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c602b-2627-447c-a82d-5e6e7eebaf31 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:28.171513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c602b-2627-447c-a82d-5e6e7eebaf31 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:28.176068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad265174-7172-4071-8daa-9d6f96903dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:28.176723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad265174-7172-4071-8daa-9d6f96903dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:28.177003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad265174-7172-4071-8daa-9d6f96903dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:28.177278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad265174-7172-4071-8daa-9d6f96903dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:28.177990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad265174-7172-4071-8daa-9d6f96903dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:28.179994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad265174-7172-4071-8daa-9d6f96903dc1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:28.276550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1143/2302] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:28 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:28.280691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4134406-cd05-4e25-ab1e-4f60bb38d580 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:28.291490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4134406-cd05-4e25-ab1e-4f60bb38d580 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:28.334454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:28.346554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac14fea-4ae3-45c8-a0ea-c750e6a24f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:28.347246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac14fea-4ae3-45c8-a0ea-c750e6a24f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:28.347526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac14fea-4ae3-45c8-a0ea-c750e6a24f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:28.347795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac14fea-4ae3-45c8-a0ea-c750e6a24f78 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:28.348522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac14fea-4ae3-45c8-a0ea-c750e6a24f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:28.350399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac14fea-4ae3-45c8-a0ea-c750e6a24f78 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:28.473331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1160/2303] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:28 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:28.474601 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad265174-7172-4071-8daa-9d6f96903dc1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:28.485232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad265174-7172-4071-8daa-9d6f96903dc1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:28.490004 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7546f47-aef1-4a97-ad88-2c469896aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:28.490668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7546f47-aef1-4a97-ad88-2c469896aa23 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:28.490950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7546f47-aef1-4a97-ad88-2c469896aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:28.491264 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7546f47-aef1-4a97-ad88-2c469896aa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:28.491990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7546f47-aef1-4a97-ad88-2c469896aa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:28.494083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7546f47-aef1-4a97-ad88-2c469896aa23 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:28.509498 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1144/2304] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:28.510583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac14fea-4ae3-45c8-a0ea-c750e6a24f78 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:28.528981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac14fea-4ae3-45c8-a0ea-c750e6a24f78 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:28.536913 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475651fd-fc36-4555-af15-8da7fadb4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:28.537971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475651fd-fc36-4555-af15-8da7fadb4f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:28.538276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475651fd-fc36-4555-af15-8da7fadb4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:28.538598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475651fd-fc36-4555-af15-8da7fadb4f11 admin admin] PATH_INFO: `/v3/projects/fdb7190921814344a509eb945279bdf8/users/98d19be7591a46fd814176b6e8805d2c/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:28.557779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475651fd-fc36-4555-af15-8da7fadb4f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb7190921814344a509eb945279bdf8, user_id=98d19be7591a46fd814176b6e8805d2c, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:28.561076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475651fd-fc36-4555-af15-8da7fadb4f11 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:28.624204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1161/2305] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:28 2022] PUT /identity/v3/projects/fdb7190921814344a509eb945279bdf8/users/98d19be7591a46fd814176b6e8805d2c/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:28.628128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7546f47-aef1-4a97-ad88-2c469896aa23 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:28.638542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7546f47-aef1-4a97-ad88-2c469896aa23 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:28.663295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:28.720140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab3f8e-6461-4dbb-ab42-6fdcd0dffc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:28.720725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab3f8e-6461-4dbb-ab42-6fdcd0dffc17 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:28.721006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab3f8e-6461-4dbb-ab42-6fdcd0dffc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:28.721288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab3f8e-6461-4dbb-ab42-6fdcd0dffc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:28.722026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab3f8e-6461-4dbb-ab42-6fdcd0dffc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:28.723700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab3f8e-6461-4dbb-ab42-6fdcd0dffc17 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:28.734243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1145/2306] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:28.738153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475651fd-fc36-4555-af15-8da7fadb4f11 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:28.750972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475651fd-fc36-4555-af15-8da7fadb4f11 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:28.758083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0bcf-831b-4aa6-aec5-477582fff4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:28.759276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0bcf-831b-4aa6-aec5-477582fff4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:28.759604 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0bcf-831b-4aa6-aec5-477582fff4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:28.764428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0bcf-831b-4aa6-aec5-477582fff4f5 admin admin] PATH_INFO: `/v3/projects/fdb7190921814344a509eb945279bdf8/users/98d19be7591a46fd814176b6e8805d2c/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:28.764428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e0bcf-831b-4aa6-aec5-477582fff4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb7190921814344a509eb945279bdf8, user_id=98d19be7591a46fd814176b6e8805d2c, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:28.766015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e0bcf-831b-4aa6-aec5-477582fff4f5 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:28.796256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1162/2307] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:28 2022] PUT /identity/v3/projects/fdb7190921814344a509eb945279bdf8/users/98d19be7591a46fd814176b6e8805d2c/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:15:28.800538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e903e-6f2c-4000-99ba-cbb2af94e676 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:28.800826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e903e-6f2c-4000-99ba-cbb2af94e676 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:28.801100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e903e-6f2c-4000-99ba-cbb2af94e676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:28.840643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cc9e903e-6f2c-4000-99ba-cbb2af94e676 None None] MFA Rules not processed for user `98d19be7591a46fd814176b6e8805d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:28.841887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cc9e903e-6f2c-4000-99ba-cbb2af94e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:28.939408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1146/2308] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:28 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:28.952553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0bcf-831b-4aa6-aec5-477582fff4f5 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:28.954373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e58e0bcf-831b-4aa6-aec5-477582fff4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:29.031303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0bcf-831b-4aa6-aec5-477582fff4f5 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:29.035358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51704ae2-9e80-4865-b0a2-75a6003efccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:29.036010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51704ae2-9e80-4865-b0a2-75a6003efccd service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:29.036296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51704ae2-9e80-4865-b0a2-75a6003efccd service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:29.036572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51704ae2-9e80-4865-b0a2-75a6003efccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:29.046417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51704ae2-9e80-4865-b0a2-75a6003efccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:29.047877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51704ae2-9e80-4865-b0a2-75a6003efccd service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:29.057899 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1163/2309] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:28 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:29.267593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e903e-6f2c-4000-99ba-cbb2af94e676 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:29.279463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e903e-6f2c-4000-99ba-cbb2af94e676 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:29.283488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743ce72-8786-4edd-90af-32df35725778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:29.290431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743ce72-8786-4edd-90af-32df35725778 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:29.290431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743ce72-8786-4edd-90af-32df35725778 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:29.290431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743ce72-8786-4edd-90af-32df35725778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:29.361229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743ce72-8786-4edd-90af-32df35725778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:29.362669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743ce72-8786-4edd-90af-32df35725778 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:29.373145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1147/2310] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:34.895967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51704ae2-9e80-4865-b0a2-75a6003efccd service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:34.897891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-51704ae2-9e80-4865-b0a2-75a6003efccd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:34.977906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51704ae2-9e80-4865-b0a2-75a6003efccd service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:34.985001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:34.987341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:34.987743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:34.988194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] PATH_INFO: `/v3/users/b0f3efdb20bf4409a586c4e03fb7628c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:34.989758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f3efdb20bf4409a586c4e03fb7628c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:34.994541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:35.230920 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:35.233723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f3efdb20bf4409a586c4e03fb7628c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.234477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f3efdb20bf4409a586c4e03fb7628c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.235233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f3efdb20bf4409a586c4e03fb7628c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.248904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f3efdb20bf4409a586c4e03fb7628c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.256243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f3efdb20bf4409a586c4e03fb7628c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.356746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1164/2311] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:34 2022] DELETE /identity/v3/users/b0f3efdb20bf4409a586c4e03fb7628c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:35.361654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bac0e-7af1-45cc-8fad-677dcfb29dda None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:35.362109 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bac0e-7af1-45cc-8fad-677dcfb29dda None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:35.362263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bac0e-7af1-45cc-8fad-677dcfb29dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:35.390327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-441bac0e-7af1-45cc-8fad-677dcfb29dda None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:35.391573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-441bac0e-7af1-45cc-8fad-677dcfb29dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:35.429531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:35.455901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1148/2312] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:35.465630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:35.467240 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:35.527142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702d47e-e98e-4126-a8bb-d06c6c9d1faf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:35.529652 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90350fd4-7633-4c9c-beb9-f3c3c7c2c03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:35.530300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90350fd4-7633-4c9c-beb9-f3c3c7c2c03a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:35.530605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90350fd4-7633-4c9c-beb9-f3c3c7c2c03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:35.530879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90350fd4-7633-4c9c-beb9-f3c3c7c2c03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:35.540369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90350fd4-7633-4c9c-beb9-f3c3c7c2c03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:35.541823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90350fd4-7633-4c9c-beb9-f3c3c7c2c03a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:35.551735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1165/2313] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:35.997692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bac0e-7af1-45cc-8fad-677dcfb29dda None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:35.999165 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-441bac0e-7af1-45cc-8fad-677dcfb29dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:36.011789 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bac0e-7af1-45cc-8fad-677dcfb29dda None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.017099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.017963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.018386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.018693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] PATH_INFO: `/v3/projects/f92a29e9893b48ab95423613f7b38bfd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.019892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92a29e9893b48ab95423613f7b38bfd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.021834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.148541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92a29e9893b48ab95423613f7b38bfd', 'request_id': 'req-ce1166a7-e855-4270-bbc0-1789113f8e6e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:36.154726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92a29e9893b48ab95423613f7b38bfd', 'request_id': 'req-ce1166a7-e855-4270-bbc0-1789113f8e6e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:36.235781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92a29e9893b48ab95423613f7b38bfd', 'request_id': 'req-ce1166a7-e855-4270-bbc0-1789113f8e6e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:36.248164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] The token cache is being invalidate because project f92a29e9893b48ab95423613f7b38bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:36.248457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:36.249097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ce1166a7-e855-4270-bbc0-1789113f8e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:36.250669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1149/2314] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:35 2022] DELETE /identity/v3/projects/f92a29e9893b48ab95423613f7b38bfd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:36.255677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793f5e-1535-48d2-9c3d-fc21805595e9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.256182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793f5e-1535-48d2-9c3d-fc21805595e9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.256403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793f5e-1535-48d2-9c3d-fc21805595e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.277071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-91793f5e-1535-48d2-9c3d-fc21805595e9 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:36.278258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-91793f5e-1535-48d2-9c3d-fc21805595e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:36.337483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1166/2315] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:36.345642 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a32556-a998-4caf-9dd9-8ed026ef6aff None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.345929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a32556-a998-4caf-9dd9-8ed026ef6aff None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.346203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a32556-a998-4caf-9dd9-8ed026ef6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.364025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-96a32556-a998-4caf-9dd9-8ed026ef6aff None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:36.365207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-96a32556-a998-4caf-9dd9-8ed026ef6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:36.373576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1150/2316] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:36.377845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91793f5e-1535-48d2-9c3d-fc21805595e9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.387729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91793f5e-1535-48d2-9c3d-fc21805595e9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.392999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fc3bc-171b-45ea-b4f9-ed8b3c368916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.393659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fc3bc-171b-45ea-b4f9-ed8b3c368916 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.393993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fc3bc-171b-45ea-b4f9-ed8b3c368916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.394282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fc3bc-171b-45ea-b4f9-ed8b3c368916 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.395005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fc3bc-171b-45ea-b4f9-ed8b3c368916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:15:36.395365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fc3bc-171b-45ea-b4f9-ed8b3c368916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.396932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fc3bc-171b-45ea-b4f9-ed8b3c368916 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.409681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1167/2317] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:15:36.413850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a32556-a998-4caf-9dd9-8ed026ef6aff None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.423664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a32556-a998-4caf-9dd9-8ed026ef6aff None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.430493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59ded-2b1f-4ecf-a72c-20666b6f0286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.431229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59ded-2b1f-4ecf-a72c-20666b6f0286 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.440343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59ded-2b1f-4ecf-a72c-20666b6f0286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.440343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59ded-2b1f-4ecf-a72c-20666b6f0286 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.440343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e59ded-2b1f-4ecf-a72c-20666b6f0286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.440343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e59ded-2b1f-4ecf-a72c-20666b6f0286 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.555528 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1151/2318] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:36 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:36.556563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fc3bc-171b-45ea-b4f9-ed8b3c368916 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.567047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fc3bc-171b-45ea-b4f9-ed8b3c368916 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.615166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:36.625926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d52b9-16af-4f20-9ac1-dedf8ceacf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.626601 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d52b9-16af-4f20-9ac1-dedf8ceacf1a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.626883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d52b9-16af-4f20-9ac1-dedf8ceacf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.627191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d52b9-16af-4f20-9ac1-dedf8ceacf1a admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.627890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d52b9-16af-4f20-9ac1-dedf8ceacf1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.629848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d52b9-16af-4f20-9ac1-dedf8ceacf1a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.719674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1168/2319] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:36 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:36.722495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59ded-2b1f-4ecf-a72c-20666b6f0286 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.733478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59ded-2b1f-4ecf-a72c-20666b6f0286 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.738820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd1e39-72d8-46e4-b7ee-578c6fc135a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.739553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd1e39-72d8-46e4-b7ee-578c6fc135a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.739835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd1e39-72d8-46e4-b7ee-578c6fc135a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.740108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd1e39-72d8-46e4-b7ee-578c6fc135a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.740833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd1e39-72d8-46e4-b7ee-578c6fc135a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.742416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd1e39-72d8-46e4-b7ee-578c6fc135a2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.763466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1152/2320] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:36.764156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d52b9-16af-4f20-9ac1-dedf8ceacf1a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.773413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d52b9-16af-4f20-9ac1-dedf8ceacf1a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.780448 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8964-8d5e-440a-b2b7-646638f9131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.781178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8964-8d5e-440a-b2b7-646638f9131f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.781466 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8964-8d5e-440a-b2b7-646638f9131f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.781741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8964-8d5e-440a-b2b7-646638f9131f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.782469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de8964-8d5e-440a-b2b7-646638f9131f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.784350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de8964-8d5e-440a-b2b7-646638f9131f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.805153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1169/2321] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:36.816067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd1e39-72d8-46e4-b7ee-578c6fc135a2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.832802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd1e39-72d8-46e4-b7ee-578c6fc135a2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.838508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbfbb-6a69-4f44-837a-22d5ee1e1931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.839236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbfbb-6a69-4f44-837a-22d5ee1e1931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.839512 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbfbb-6a69-4f44-837a-22d5ee1e1931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.839828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbfbb-6a69-4f44-837a-22d5ee1e1931 admin admin] PATH_INFO: `/v3/projects/6c5b7f5b864a4a469865f0c22e4ceb54/users/d0d051a5145c4e19a29060b40f4aebee/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.858212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fbfbb-6a69-4f44-837a-22d5ee1e1931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5b7f5b864a4a469865f0c22e4ceb54, user_id=d0d051a5145c4e19a29060b40f4aebee, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.862182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fbfbb-6a69-4f44-837a-22d5ee1e1931 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.949715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1153/2322] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:36 2022] PUT /identity/v3/projects/6c5b7f5b864a4a469865f0c22e4ceb54/users/d0d051a5145c4e19a29060b40f4aebee/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:36.961279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b8c02-2358-4215-85b7-5c156f410278 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.961567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b8c02-2358-4215-85b7-5c156f410278 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.961844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b8c02-2358-4215-85b7-5c156f410278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.990186 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-c07b8c02-2358-4215-85b7-5c156f410278 None None] MFA Rules not processed for user `d0d051a5145c4e19a29060b40f4aebee`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:36.991440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c07b8c02-2358-4215-85b7-5c156f410278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:37.061471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1170/2323] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:37.075175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbfbb-6a69-4f44-837a-22d5ee1e1931 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:37.077450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3e9fbfbb-6a69-4f44-837a-22d5ee1e1931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:37.150778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbfbb-6a69-4f44-837a-22d5ee1e1931 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:37.154555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d39ad-60bb-4ca5-a77f-4a0742c928e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:37.155238 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d39ad-60bb-4ca5-a77f-4a0742c928e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:37.156049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d39ad-60bb-4ca5-a77f-4a0742c928e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:37.156353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d39ad-60bb-4ca5-a77f-4a0742c928e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:37.166433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d39ad-60bb-4ca5-a77f-4a0742c928e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:37.168193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d39ad-60bb-4ca5-a77f-4a0742c928e2 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:37.182507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1154/2324] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:39.515808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b8c02-2358-4215-85b7-5c156f410278 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:39.517322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c07b8c02-2358-4215-85b7-5c156f410278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:39.585179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b8c02-2358-4215-85b7-5c156f410278 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:39.589656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:39.590519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:39.590803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:39.591075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] PATH_INFO: `/v3/users/9c6163500b1b426a95adb05e2151b51c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:39.592275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6163500b1b426a95adb05e2151b51c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:39.594199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:39.787645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6163500b1b426a95adb05e2151b51c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:39.788407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6163500b1b426a95adb05e2151b51c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:39.789012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6163500b1b426a95adb05e2151b51c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:39.800663 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:39.805241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6163500b1b426a95adb05e2151b51c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:39.809513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6163500b1b426a95adb05e2151b51c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:39.870384 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1171/2325] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:39 2022] DELETE /identity/v3/users/9c6163500b1b426a95adb05e2151b51c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:39.875711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069e42d-8880-4d2c-aec4-0b00228aceb5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:39.876235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069e42d-8880-4d2c-aec4-0b00228aceb5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:39.876235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069e42d-8880-4d2c-aec4-0b00228aceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:39.882721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:39.895112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b069e42d-8880-4d2c-aec4-0b00228aceb5 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:39.896321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b069e42d-8880-4d2c-aec4-0b00228aceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:39.954610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1155/2326] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:39.964541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:39.966011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:40.025191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbdfbe-0494-4596-ba17-983b0bd6478e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:40.028836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74117f6b-2e40-455c-963a-1073dc0e9a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:40.029497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117f6b-2e40-455c-963a-1073dc0e9a26 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:40.029782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117f6b-2e40-455c-963a-1073dc0e9a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:40.030054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117f6b-2e40-455c-963a-1073dc0e9a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:40.039517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74117f6b-2e40-455c-963a-1073dc0e9a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:40.040968 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74117f6b-2e40-455c-963a-1073dc0e9a26 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:40.051032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1172/2327] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:40.451698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069e42d-8880-4d2c-aec4-0b00228aceb5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:40.453321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b069e42d-8880-4d2c-aec4-0b00228aceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:40.465950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069e42d-8880-4d2c-aec4-0b00228aceb5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:40.477094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:40.477094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:40.477094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:40.477094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] PATH_INFO: `/v3/projects/60f2fcc90e7c4f10aded1ce3a8e86999` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:40.477539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f2fcc90e7c4f10aded1ce3a8e86999)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:40.477964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:40.588387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f2fcc90e7c4f10aded1ce3a8e86999', 'request_id': 'req-8df880cd-7aac-4a4d-a323-eec98822fbbc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:40.595336 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f2fcc90e7c4f10aded1ce3a8e86999', 'request_id': 'req-8df880cd-7aac-4a4d-a323-eec98822fbbc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:40.678574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f2fcc90e7c4f10aded1ce3a8e86999', 'request_id': 'req-8df880cd-7aac-4a4d-a323-eec98822fbbc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:40.689714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] The token cache is being invalidate because project 60f2fcc90e7c4f10aded1ce3a8e86999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:40.690005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:40.690628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:40.692367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1156/2328] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:40 2022] DELETE /identity/v3/projects/60f2fcc90e7c4f10aded1ce3a8e86999 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:40.696271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74117f6b-2e40-455c-963a-1073dc0e9a26 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:40.706262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74117f6b-2e40-455c-963a-1073dc0e9a26 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:40.761327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:40.762197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:40.762477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:40.762749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] PATH_INFO: `/v3/users/98d19be7591a46fd814176b6e8805d2c` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:40.763975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d19be7591a46fd814176b6e8805d2c)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:40.766496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:40.941160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d19be7591a46fd814176b6e8805d2c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:40.941801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d19be7591a46fd814176b6e8805d2c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:40.944112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d19be7591a46fd814176b6e8805d2c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:40.956684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d19be7591a46fd814176b6e8805d2c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:40.963989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-1722e827-3746-4644-8fe7-25bb702ab58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d19be7591a46fd814176b6e8805d2c'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:41.054427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:41.058845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1173/2329] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:40 2022] DELETE /identity/v3/users/98d19be7591a46fd814176b6e8805d2c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:41.541628 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:41.543636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:41.565388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df880cd-7aac-4a4d-a323-eec98822fbbc admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:41.644139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:41.645096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:41.645394 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:41.645732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] PATH_INFO: `/v3/projects/fdb7190921814344a509eb945279bdf8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:41.646951 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb7190921814344a509eb945279bdf8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:41.649194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:41.768111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:41.783679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb7190921814344a509eb945279bdf8', 'request_id': 'req-880da16e-7c43-4a35-8749-47573908b3e1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:41.791412 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb7190921814344a509eb945279bdf8', 'request_id': 'req-880da16e-7c43-4a35-8749-47573908b3e1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:41.881490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb7190921814344a509eb945279bdf8', 'request_id': 'req-880da16e-7c43-4a35-8749-47573908b3e1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:41.894790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] The token cache is being invalidate because project fdb7190921814344a509eb945279bdf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:41.895081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:41.895840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-880da16e-7c43-4a35-8749-47573908b3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:41.897395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1157/2330] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:41 2022] DELETE /identity/v3/projects/fdb7190921814344a509eb945279bdf8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:15:41.902398 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65154c-90a1-4819-a537-7aa4f3744449 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:41.902870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65154c-90a1-4819-a537-7aa4f3744449 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:41.903195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65154c-90a1-4819-a537-7aa4f3744449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:41.921932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0a65154c-90a1-4819-a537-7aa4f3744449 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:41.923136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0a65154c-90a1-4819-a537-7aa4f3744449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:41.993243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1174/2331] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:42.002640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54dfea-ca86-40a0-b64d-3a33210eb4a6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.002953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54dfea-ca86-40a0-b64d-3a33210eb4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.003284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54dfea-ca86-40a0-b64d-3a33210eb4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.023175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5c54dfea-ca86-40a0-b64d-3a33210eb4a6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:42.023971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5c54dfea-ca86-40a0-b64d-3a33210eb4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:42.032459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1158/2332] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:42.036745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65154c-90a1-4819-a537-7aa4f3744449 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:42.048819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65154c-90a1-4819-a537-7aa4f3744449 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:42.055522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b2fd1-01b3-4873-a924-c4325b26da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:42.056190 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2fd1-01b3-4873-a924-c4325b26da1e admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.056471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2fd1-01b3-4873-a924-c4325b26da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.056750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2fd1-01b3-4873-a924-c4325b26da1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.057593 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b2fd1-01b3-4873-a924-c4325b26da1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:15:42.057909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b2fd1-01b3-4873-a924-c4325b26da1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:42.059683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b2fd1-01b3-4873-a924-c4325b26da1e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:42.072890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1175/2333] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:15:42.077593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54dfea-ca86-40a0-b64d-3a33210eb4a6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:42.087676 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54dfea-ca86-40a0-b64d-3a33210eb4a6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:42.092555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b57dc-8823-4ae2-9190-f48d379ad01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:42.093802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b57dc-8823-4ae2-9190-f48d379ad01b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.094087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b57dc-8823-4ae2-9190-f48d379ad01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.094364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b57dc-8823-4ae2-9190-f48d379ad01b admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.095061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b57dc-8823-4ae2-9190-f48d379ad01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:42.097066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b57dc-8823-4ae2-9190-f48d379ad01b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:42.208816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1159/2334] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:42 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:15:42.212985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b2fd1-01b3-4873-a924-c4325b26da1e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:42.223651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b2fd1-01b3-4873-a924-c4325b26da1e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:42.288917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5ef3-0a98-4309-800d-f33b477feee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:42.289593 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5ef3-0a98-4309-800d-f33b477feee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.289876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5ef3-0a98-4309-800d-f33b477feee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.290152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5ef3-0a98-4309-800d-f33b477feee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.290843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd5ef3-0a98-4309-800d-f33b477feee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:42.292807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd5ef3-0a98-4309-800d-f33b477feee6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:42.390534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1176/2335] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:42 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:42.404317 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b57dc-8823-4ae2-9190-f48d379ad01b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:42.415761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b57dc-8823-4ae2-9190-f48d379ad01b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:42.420504 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48ca0a-07ce-4fd0-8388-c6a197850f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:42.421255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48ca0a-07ce-4fd0-8388-c6a197850f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.421563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48ca0a-07ce-4fd0-8388-c6a197850f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.421834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48ca0a-07ce-4fd0-8388-c6a197850f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.422557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48ca0a-07ce-4fd0-8388-c6a197850f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:42.426940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48ca0a-07ce-4fd0-8388-c6a197850f9a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:42.434704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1160/2336] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:42.439524 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5ef3-0a98-4309-800d-f33b477feee6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:42.450971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5ef3-0a98-4309-800d-f33b477feee6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:42.456226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c470e0-740b-49d2-b615-fced3e5e0573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:42.456884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c470e0-740b-49d2-b615-fced3e5e0573 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.457165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c470e0-740b-49d2-b615-fced3e5e0573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.457437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c470e0-740b-49d2-b615-fced3e5e0573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.458158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c470e0-740b-49d2-b615-fced3e5e0573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:42.459773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c470e0-740b-49d2-b615-fced3e5e0573 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:42.469850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1177/2337] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:42.473896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48ca0a-07ce-4fd0-8388-c6a197850f9a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:42.484184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48ca0a-07ce-4fd0-8388-c6a197850f9a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:42.488780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c37887-3082-41fb-a836-5745f321d7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:42.489680 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c37887-3082-41fb-a836-5745f321d7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.489962 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c37887-3082-41fb-a836-5745f321d7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.490238 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c37887-3082-41fb-a836-5745f321d7bf admin admin] PATH_INFO: `/v3/projects/a189e0450e334262bfd8d7f4d45ec0a9/users/49c35296b021408fb933bbfc774b21b9/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.506654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c37887-3082-41fb-a836-5745f321d7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a189e0450e334262bfd8d7f4d45ec0a9, user_id=49c35296b021408fb933bbfc774b21b9, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:42.509303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c37887-3082-41fb-a836-5745f321d7bf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:42.613418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1161/2338] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:42 2022] PUT /identity/v3/projects/a189e0450e334262bfd8d7f4d45ec0a9/users/49c35296b021408fb933bbfc774b21b9/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:15:42.625735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58cff2-dbf8-4bf7-8b3d-b5a754483b74 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.626100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58cff2-dbf8-4bf7-8b3d-b5a754483b74 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.626447 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58cff2-dbf8-4bf7-8b3d-b5a754483b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.664131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-7a58cff2-dbf8-4bf7-8b3d-b5a754483b74 None None] MFA Rules not processed for user `49c35296b021408fb933bbfc774b21b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:42.665338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7a58cff2-dbf8-4bf7-8b3d-b5a754483b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:42.726326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:42.736796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1178/2339] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:42.748422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c37887-3082-41fb-a836-5745f321d7bf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:42.750675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-02c37887-3082-41fb-a836-5745f321d7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:42.851867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c37887-3082-41fb-a836-5745f321d7bf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:42.857206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170da2-d725-49d5-bf72-a680e4f49df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:42.858765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170da2-d725-49d5-bf72-a680e4f49df2 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.859580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170da2-d725-49d5-bf72-a680e4f49df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.860037 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170da2-d725-49d5-bf72-a680e4f49df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.872017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170da2-d725-49d5-bf72-a680e4f49df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:42.873465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170da2-d725-49d5-bf72-a680e4f49df2 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:42.885274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1162/2340] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:42.907539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58cff2-dbf8-4bf7-8b3d-b5a754483b74 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:42.972011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58cff2-dbf8-4bf7-8b3d-b5a754483b74 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:42.977425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:42.978325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:42.978598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:42.978863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] PATH_INFO: `/v3/users/49c35296b021408fb933bbfc774b21b9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:42.980191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c35296b021408fb933bbfc774b21b9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:42.982358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:43.177024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c35296b021408fb933bbfc774b21b9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:43.177668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c35296b021408fb933bbfc774b21b9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:43.178354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c35296b021408fb933bbfc774b21b9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:43.197554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c35296b021408fb933bbfc774b21b9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:43.212287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c35296b021408fb933bbfc774b21b9'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:43.308828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1179/2341] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:42 2022] DELETE /identity/v3/users/49c35296b021408fb933bbfc774b21b9 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:43.313145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e631966-5bc8-40c8-8ac8-aa87b38cebf5 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:43.313522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e631966-5bc8-40c8-8ac8-aa87b38cebf5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:43.313859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e631966-5bc8-40c8-8ac8-aa87b38cebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:43.336696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5e631966-5bc8-40c8-8ac8-aa87b38cebf5 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:43.338199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e631966-5bc8-40c8-8ac8-aa87b38cebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:43.377373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:43.410884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1163/2342] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:43.420581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:43.422890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:43.494145 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61173646-1641-4ffa-bf79-7801a0f3a90d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:43.498041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d817-303a-46d6-a85a-d94d90199117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:43.498810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d817-303a-46d6-a85a-d94d90199117 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:43.499138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d817-303a-46d6-a85a-d94d90199117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:43.499420 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d817-303a-46d6-a85a-d94d90199117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:43.519614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320d817-303a-46d6-a85a-d94d90199117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:43.519614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320d817-303a-46d6-a85a-d94d90199117 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:43.529979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1180/2343] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:44.128261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e631966-5bc8-40c8-8ac8-aa87b38cebf5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:44.129880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e631966-5bc8-40c8-8ac8-aa87b38cebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:44.146380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e631966-5bc8-40c8-8ac8-aa87b38cebf5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:44.159968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:44.161016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:44.163666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:44.163998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] PATH_INFO: `/v3/projects/a189e0450e334262bfd8d7f4d45ec0a9` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:44.165856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a189e0450e334262bfd8d7f4d45ec0a9)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:44.168648 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:44.300144 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a189e0450e334262bfd8d7f4d45ec0a9', 'request_id': 'req-7b6735c3-fc64-46bc-a895-68463632c061'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:44.306593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a189e0450e334262bfd8d7f4d45ec0a9', 'request_id': 'req-7b6735c3-fc64-46bc-a895-68463632c061'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:44.389806 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a189e0450e334262bfd8d7f4d45ec0a9', 'request_id': 'req-7b6735c3-fc64-46bc-a895-68463632c061'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:44.402453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] The token cache is being invalidate because project a189e0450e334262bfd8d7f4d45ec0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:44.402741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:44.403454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-7b6735c3-fc64-46bc-a895-68463632c061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:44.405245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1164/2344] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:44 2022] DELETE /identity/v3/projects/a189e0450e334262bfd8d7f4d45ec0a9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:44.410361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c41ade-7001-42f9-b3ce-1d8c2fb8ebc0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:44.410878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c41ade-7001-42f9-b3ce-1d8c2fb8ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:44.411007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c41ade-7001-42f9-b3ce-1d8c2fb8ebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:44.430710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-62c41ade-7001-42f9-b3ce-1d8c2fb8ebc0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:44.431931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-62c41ade-7001-42f9-b3ce-1d8c2fb8ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:44.445880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:44.498149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1181/2345] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:44.506613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940896d9-6c68-46fb-b612-c5b13d4be1dd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:44.506942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940896d9-6c68-46fb-b612-c5b13d4be1dd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:44.507252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940896d9-6c68-46fb-b612-c5b13d4be1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:44.552866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-940896d9-6c68-46fb-b612-c5b13d4be1dd None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:44.554250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-940896d9-6c68-46fb-b612-c5b13d4be1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:44.565358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1165/2346] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:44.569727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c41ade-7001-42f9-b3ce-1d8c2fb8ebc0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:44.580528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c41ade-7001-42f9-b3ce-1d8c2fb8ebc0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:44.585807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9486a-65d9-4a97-924c-3e31d8bd2372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:44.586592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9486a-65d9-4a97-924c-3e31d8bd2372 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:44.586950 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9486a-65d9-4a97-924c-3e31d8bd2372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:44.587322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9486a-65d9-4a97-924c-3e31d8bd2372 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:44.588159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9486a-65d9-4a97-924c-3e31d8bd2372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:15:44.588562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9486a-65d9-4a97-924c-3e31d8bd2372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:44.590263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9486a-65d9-4a97-924c-3e31d8bd2372 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:44.605806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1182/2347] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:15:44.611586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940896d9-6c68-46fb-b612-c5b13d4be1dd None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:44.624828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940896d9-6c68-46fb-b612-c5b13d4be1dd None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:44.630329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8784c-cc46-48d7-a9aa-643bff411ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:44.631132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8784c-cc46-48d7-a9aa-643bff411ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:44.631564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8784c-cc46-48d7-a9aa-643bff411ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:44.631944 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8784c-cc46-48d7-a9aa-643bff411ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:44.632702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8784c-cc46-48d7-a9aa-643bff411ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:44.635130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8784c-cc46-48d7-a9aa-643bff411ce2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:44.729148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1166/2348] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:44 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:15:44.733926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9486a-65d9-4a97-924c-3e31d8bd2372 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:44.748191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9486a-65d9-4a97-924c-3e31d8bd2372 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:44.811277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a660041-09f4-45ec-85ad-d9729a11cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:44.811277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a660041-09f4-45ec-85ad-d9729a11cadd admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:44.811277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a660041-09f4-45ec-85ad-d9729a11cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:44.811277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a660041-09f4-45ec-85ad-d9729a11cadd admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:44.811619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a660041-09f4-45ec-85ad-d9729a11cadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:44.811619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a660041-09f4-45ec-85ad-d9729a11cadd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:44.920042 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1183/2349] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:44 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:15:44.924516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8784c-cc46-48d7-a9aa-643bff411ce2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:44.934825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8784c-cc46-48d7-a9aa-643bff411ce2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:44.939585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6611da-2acd-4191-a0b4-307e89319c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:44.940345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6611da-2acd-4191-a0b4-307e89319c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:44.940749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6611da-2acd-4191-a0b4-307e89319c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:44.941021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6611da-2acd-4191-a0b4-307e89319c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:44.941972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6611da-2acd-4191-a0b4-307e89319c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:44.943765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6611da-2acd-4191-a0b4-307e89319c54 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:44.955871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1167/2350] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:44.959745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a660041-09f4-45ec-85ad-d9729a11cadd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:44.970728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a660041-09f4-45ec-85ad-d9729a11cadd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:44.975496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1d3ce-2e37-4154-9a61-5163d3c7d7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:44.976150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1d3ce-2e37-4154-9a61-5163d3c7d7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:44.979219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1d3ce-2e37-4154-9a61-5163d3c7d7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:44.979219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1d3ce-2e37-4154-9a61-5163d3c7d7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:44.979219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1d3ce-2e37-4154-9a61-5163d3c7d7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:44.981382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1d3ce-2e37-4154-9a61-5163d3c7d7f4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:44.997224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1184/2351] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:44.998546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6611da-2acd-4191-a0b4-307e89319c54 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:45.010375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6611da-2acd-4191-a0b4-307e89319c54 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:45.016573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cf22c-345b-4af0-bc6a-5a090cd7cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:45.018492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf22c-345b-4af0-bc6a-5a090cd7cf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:45.018854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf22c-345b-4af0-bc6a-5a090cd7cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:45.019465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf22c-345b-4af0-bc6a-5a090cd7cf94 admin admin] PATH_INFO: `/v3/projects/86939fc2ddf745a68b73ae045daad92c/users/10676d8039d84b2d968076b0c66183ce/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:45.038338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cf22c-345b-4af0-bc6a-5a090cd7cf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86939fc2ddf745a68b73ae045daad92c, user_id=10676d8039d84b2d968076b0c66183ce, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:45.041166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cf22c-345b-4af0-bc6a-5a090cd7cf94 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:45.147304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1168/2352] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:44 2022] PUT /identity/v3/projects/86939fc2ddf745a68b73ae045daad92c/users/10676d8039d84b2d968076b0c66183ce/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:45.159266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d708d-56cc-4c25-aa43-ddca27b993e5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:45.159585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d708d-56cc-4c25-aa43-ddca27b993e5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:45.159870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d708d-56cc-4c25-aa43-ddca27b993e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:45.194351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-3d8d708d-56cc-4c25-aa43-ddca27b993e5 None None] MFA Rules not processed for user `10676d8039d84b2d968076b0c66183ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:45.195659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3d8d708d-56cc-4c25-aa43-ddca27b993e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:45.293814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1185/2353] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:45.306291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cf22c-345b-4af0-bc6a-5a090cd7cf94 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:45.308087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-af4cf22c-345b-4af0-bc6a-5a090cd7cf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:45.369868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cf22c-345b-4af0-bc6a-5a090cd7cf94 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:45.373391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd84859-4e36-4b50-a407-767d31b60998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:45.374064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd84859-4e36-4b50-a407-767d31b60998 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:45.374470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd84859-4e36-4b50-a407-767d31b60998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:45.374743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd84859-4e36-4b50-a407-767d31b60998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:45.383034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd84859-4e36-4b50-a407-767d31b60998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:45.384470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd84859-4e36-4b50-a407-767d31b60998 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:45.387942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:45.394171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1169/2354] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:48.698131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6dad-bb3f-4a73-9748-3e8ff92c1d52 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:48.698573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6dad-bb3f-4a73-9748-3e8ff92c1d52 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:48.698866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6dad-bb3f-4a73-9748-3e8ff92c1d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:48.717796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-be8c6dad-bb3f-4a73-9748-3e8ff92c1d52 None None] MFA Rules not processed for user `a696d00855ef439c9d80b6bec5312f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:48.721974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-be8c6dad-bb3f-4a73-9748-3e8ff92c1d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:48.727902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:48.809082 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1186/2355] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:49.115948 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd84859-4e36-4b50-a407-767d31b60998 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:49.121131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bfd84859-4e36-4b50-a407-767d31b60998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:49.199358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd84859-4e36-4b50-a407-767d31b60998 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:49.206532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723e543-3584-4956-b375-f573047b443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:49.206532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723e543-3584-4956-b375-f573047b443f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:49.206532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723e543-3584-4956-b375-f573047b443f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:49.206532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723e543-3584-4956-b375-f573047b443f admin admin] PATH_INFO: `/v3/users/d0d051a5145c4e19a29060b40f4aebee` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:49.206904 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723e543-3584-4956-b375-f573047b443f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d051a5145c4e19a29060b40f4aebee)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:49.208780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723e543-3584-4956-b375-f573047b443f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:49.411164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9723e543-3584-4956-b375-f573047b443f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d051a5145c4e19a29060b40f4aebee'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:49.411861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9723e543-3584-4956-b375-f573047b443f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d051a5145c4e19a29060b40f4aebee'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:49.427796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9723e543-3584-4956-b375-f573047b443f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d051a5145c4e19a29060b40f4aebee'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:49.437960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9723e543-3584-4956-b375-f573047b443f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d051a5145c4e19a29060b40f4aebee'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:49.437960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9723e543-3584-4956-b375-f573047b443f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d051a5145c4e19a29060b40f4aebee'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:49.504837 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1170/2356] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:49 2022] DELETE /identity/v3/users/d0d051a5145c4e19a29060b40f4aebee => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:49.509110 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e238d4-f0f9-446d-bf79-037f45c39ad5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:49.509593 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e238d4-f0f9-446d-bf79-037f45c39ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:49.510279 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e238d4-f0f9-446d-bf79-037f45c39ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:49.527926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f7e238d4-f0f9-446d-bf79-037f45c39ad5 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:49.529129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f7e238d4-f0f9-446d-bf79-037f45c39ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:49.621778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1187/2357] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:49.633000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723e543-3584-4956-b375-f573047b443f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:49.634920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9723e543-3584-4956-b375-f573047b443f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:49.709921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723e543-3584-4956-b375-f573047b443f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:49.714280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707cd4b-26d8-4148-b7c9-e62f5368cb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:49.715198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707cd4b-26d8-4148-b7c9-e62f5368cb3f service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:49.715713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707cd4b-26d8-4148-b7c9-e62f5368cb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:49.716028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707cd4b-26d8-4148-b7c9-e62f5368cb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:49.727526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707cd4b-26d8-4148-b7c9-e62f5368cb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:49.728995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707cd4b-26d8-4148-b7c9-e62f5368cb3f service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:49.740286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1171/2358] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:50.178810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e238d4-f0f9-446d-bf79-037f45c39ad5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:50.180866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f7e238d4-f0f9-446d-bf79-037f45c39ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:50.198094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e238d4-f0f9-446d-bf79-037f45c39ad5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:50.203806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:50.204748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:50.205096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:50.205606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] PATH_INFO: `/v3/projects/6c5b7f5b864a4a469865f0c22e4ceb54` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:50.206872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5b7f5b864a4a469865f0c22e4ceb54)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:50.209013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:50.373963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5b7f5b864a4a469865f0c22e4ceb54', 'request_id': 'req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:50.380281 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5b7f5b864a4a469865f0c22e4ceb54', 'request_id': 'req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:50.521348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5b7f5b864a4a469865f0c22e4ceb54', 'request_id': 'req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:50.534146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] The token cache is being invalidate because project 6c5b7f5b864a4a469865f0c22e4ceb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:50.534442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:50.535117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-f51b310f-1a5d-49c7-adfd-a4d490c35ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:50.536713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1188/2359] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:50 2022] DELETE /identity/v3/projects/6c5b7f5b864a4a469865f0c22e4ceb54 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:50.541472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41823ca2-d36a-4277-9c8a-671d95648cd0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:50.541967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41823ca2-d36a-4277-9c8a-671d95648cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:50.542072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41823ca2-d36a-4277-9c8a-671d95648cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:50.560305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-41823ca2-d36a-4277-9c8a-671d95648cd0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:50.561488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-41823ca2-d36a-4277-9c8a-671d95648cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:50.574260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:50.620572 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1172/2360] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:50.628807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456307-091b-4667-b05e-b3372913f97a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:50.629094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456307-091b-4667-b05e-b3372913f97a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:50.629370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456307-091b-4667-b05e-b3372913f97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:50.648456 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6e456307-091b-4667-b05e-b3372913f97a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:50.649890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6e456307-091b-4667-b05e-b3372913f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:50.657544 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1189/2361] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:50.661745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41823ca2-d36a-4277-9c8a-671d95648cd0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:50.671587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41823ca2-d36a-4277-9c8a-671d95648cd0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:50.676674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be1f7e-3db8-4240-bbb1-51c51e183cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:50.677331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be1f7e-3db8-4240-bbb1-51c51e183cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:50.677611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be1f7e-3db8-4240-bbb1-51c51e183cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:50.677883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be1f7e-3db8-4240-bbb1-51c51e183cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:50.678613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be1f7e-3db8-4240-bbb1-51c51e183cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:15:50.678917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be1f7e-3db8-4240-bbb1-51c51e183cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:50.680535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be1f7e-3db8-4240-bbb1-51c51e183cf0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:50.692493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1173/2362] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:15:50.696969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e456307-091b-4667-b05e-b3372913f97a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:50.707059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e456307-091b-4667-b05e-b3372913f97a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:50.711993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f8d89-8ce1-4091-a2bb-88c8b5c7c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:50.712707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f8d89-8ce1-4091-a2bb-88c8b5c7c7bf admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:50.713011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f8d89-8ce1-4091-a2bb-88c8b5c7c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:50.713282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f8d89-8ce1-4091-a2bb-88c8b5c7c7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:50.714055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f8d89-8ce1-4091-a2bb-88c8b5c7c7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:50.715974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f8d89-8ce1-4091-a2bb-88c8b5c7c7bf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:50.790872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1190/2363] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:50 2022] POST /identity/v3/projects => generated 399 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:50.794940 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be1f7e-3db8-4240-bbb1-51c51e183cf0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:50.804953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be1f7e-3db8-4240-bbb1-51c51e183cf0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:50.861581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35854207-553d-4502-9ff8-e58953d9f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:50.862249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35854207-553d-4502-9ff8-e58953d9f23c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:50.862532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35854207-553d-4502-9ff8-e58953d9f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:50.862807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35854207-553d-4502-9ff8-e58953d9f23c admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:50.863561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35854207-553d-4502-9ff8-e58953d9f23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:50.865475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35854207-553d-4502-9ff8-e58953d9f23c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:50.944809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1174/2364] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:50 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:50.948573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f8d89-8ce1-4091-a2bb-88c8b5c7c7bf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:50.959549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f8d89-8ce1-4091-a2bb-88c8b5c7c7bf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:50.964303 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d6b4f-eb0a-4d25-a011-8a8fdb55ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:50.964954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d6b4f-eb0a-4d25-a011-8a8fdb55ced6 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:50.965232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d6b4f-eb0a-4d25-a011-8a8fdb55ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:50.965504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d6b4f-eb0a-4d25-a011-8a8fdb55ced6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:50.966223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d6b4f-eb0a-4d25-a011-8a8fdb55ced6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:50.967819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d6b4f-eb0a-4d25-a011-8a8fdb55ced6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:50.978155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1191/2365] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:50.981981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35854207-553d-4502-9ff8-e58953d9f23c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:50.992389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35854207-553d-4502-9ff8-e58953d9f23c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:50.997182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535bdd1-df5e-4144-8e9f-011194037298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:50.997827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535bdd1-df5e-4144-8e9f-011194037298 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:50.998110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535bdd1-df5e-4144-8e9f-011194037298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:50.998386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535bdd1-df5e-4144-8e9f-011194037298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:50.999118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535bdd1-df5e-4144-8e9f-011194037298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:51.001339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535bdd1-df5e-4144-8e9f-011194037298 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:51.010993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1175/2366] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:51.014779 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d6b4f-eb0a-4d25-a011-8a8fdb55ced6 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:51.019893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:51.025033 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d6b4f-eb0a-4d25-a011-8a8fdb55ced6 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:51.029911 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca868-e10e-420c-a0ca-a70051e730ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:51.030870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca868-e10e-420c-a0ca-a70051e730ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:51.031211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca868-e10e-420c-a0ca-a70051e730ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:51.031485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca868-e10e-420c-a0ca-a70051e730ce admin admin] PATH_INFO: `/v3/projects/0ca07b913f344dee9ce1a5ba5d066567/users/48a3f8346efb48f085b143d04044eef8/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:51.045636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ca868-e10e-420c-a0ca-a70051e730ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca07b913f344dee9ce1a5ba5d066567, user_id=48a3f8346efb48f085b143d04044eef8, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:51.048773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ca868-e10e-420c-a0ca-a70051e730ce admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:51.135605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1192/2367] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:51 2022] PUT /identity/v3/projects/0ca07b913f344dee9ce1a5ba5d066567/users/48a3f8346efb48f085b143d04044eef8/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:51.145712 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754855ff-2fda-4f99-a74d-15bf63a65116 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:51.146049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754855ff-2fda-4f99-a74d-15bf63a65116 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:51.146327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754855ff-2fda-4f99-a74d-15bf63a65116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:51.173005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-754855ff-2fda-4f99-a74d-15bf63a65116 None None] MFA Rules not processed for user `48a3f8346efb48f085b143d04044eef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:51.174236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-754855ff-2fda-4f99-a74d-15bf63a65116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:51.237125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1176/2368] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:51.248470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca868-e10e-420c-a0ca-a70051e730ce admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:51.250772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-608ca868-e10e-420c-a0ca-a70051e730ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:51.316503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca868-e10e-420c-a0ca-a70051e730ce admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:51.320170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c0828-3a99-4636-92c1-da36cdb99fc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:51.320817 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0828-3a99-4636-92c1-da36cdb99fc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:51.321100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0828-3a99-4636-92c1-da36cdb99fc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:51.323435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0828-3a99-4636-92c1-da36cdb99fc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:51.329884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c0828-3a99-4636-92c1-da36cdb99fc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:51.331364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c0828-3a99-4636-92c1-da36cdb99fc8 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:51.340168 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1193/2369] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:01.233891 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:01.336117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:11.857049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754855ff-2fda-4f99-a74d-15bf63a65116 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:11.926886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754855ff-2fda-4f99-a74d-15bf63a65116 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:11.931599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:11.932800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:11.933082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:11.933358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] PATH_INFO: `/v3/users/48a3f8346efb48f085b143d04044eef8` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:11.934587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a3f8346efb48f085b143d04044eef8)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:11.936535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:12.127841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a3f8346efb48f085b143d04044eef8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:12.128427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a3f8346efb48f085b143d04044eef8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:12.140740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a3f8346efb48f085b143d04044eef8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:12.147862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a3f8346efb48f085b143d04044eef8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:12.148517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a3f8346efb48f085b143d04044eef8'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:12.214917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1177/2370] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:16:11 2022] DELETE /identity/v3/users/48a3f8346efb48f085b143d04044eef8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:12.219363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44de471-4054-4a0d-b3bc-a68ad07dcf77 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:12.219847 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44de471-4054-4a0d-b3bc-a68ad07dcf77 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:12.220047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44de471-4054-4a0d-b3bc-a68ad07dcf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:12.237813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a44de471-4054-4a0d-b3bc-a68ad07dcf77 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:12.238996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a44de471-4054-4a0d-b3bc-a68ad07dcf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:12.298461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1194/2371] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:12.308142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:12.309589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:12.371354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24679356-bc86-4c33-a431-7286a88741aa admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:12.374961 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa5b64-5cbf-4b49-9a3d-ea1df0e363c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:12.375623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa5b64-5cbf-4b49-9a3d-ea1df0e363c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:12.375935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa5b64-5cbf-4b49-9a3d-ea1df0e363c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:12.376212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa5b64-5cbf-4b49-9a3d-ea1df0e363c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:12.385268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa5b64-5cbf-4b49-9a3d-ea1df0e363c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:12.386632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa5b64-5cbf-4b49-9a3d-ea1df0e363c7 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:12.396190 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1178/2372] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:12.469388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44de471-4054-4a0d-b3bc-a68ad07dcf77 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:12.471555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a44de471-4054-4a0d-b3bc-a68ad07dcf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:12.584502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44de471-4054-4a0d-b3bc-a68ad07dcf77 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:12.590088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbffc4-84c1-44a7-a3bc-7175ee4c7542 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:12.591061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbffc4-84c1-44a7-a3bc-7175ee4c7542 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:12.591403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbffc4-84c1-44a7-a3bc-7175ee4c7542 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:12.591799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbffc4-84c1-44a7-a3bc-7175ee4c7542 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:12.593749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-97cbffc4-84c1-44a7-a3bc-7175ee4c7542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:12.607274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbffc4-84c1-44a7-a3bc-7175ee4c7542 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:12.609355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbffc4-84c1-44a7-a3bc-7175ee4c7542 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:12.625224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1195/2373] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:12.893955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa5b64-5cbf-4b49-9a3d-ea1df0e363c7 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:12.895895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-09aa5b64-5cbf-4b49-9a3d-ea1df0e363c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:12.909491 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa5b64-5cbf-4b49-9a3d-ea1df0e363c7 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:12.914373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:12.916200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:12.920049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:12.920049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] PATH_INFO: `/v3/projects/0ca07b913f344dee9ce1a5ba5d066567` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:12.920049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca07b913f344dee9ce1a5ba5d066567)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:12.921235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:12.944743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:13.040726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca07b913f344dee9ce1a5ba5d066567', 'request_id': 'req-a9507140-09a9-4097-9674-3392cfd9af2c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:13.047237 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca07b913f344dee9ce1a5ba5d066567', 'request_id': 'req-a9507140-09a9-4097-9674-3392cfd9af2c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:13.137640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca07b913f344dee9ce1a5ba5d066567', 'request_id': 'req-a9507140-09a9-4097-9674-3392cfd9af2c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:13.149314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] The token cache is being invalidate because project 0ca07b913f344dee9ce1a5ba5d066567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:16:13.149710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:13.150491 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-a9507140-09a9-4097-9674-3392cfd9af2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:13.152332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1179/2374] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:16:12 2022] DELETE /identity/v3/projects/0ca07b913f344dee9ce1a5ba5d066567 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:13.157482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2077-99c9-4a46-a9bb-c0b761ef7101 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:13.157866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2077-99c9-4a46-a9bb-c0b761ef7101 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:13.158229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2077-99c9-4a46-a9bb-c0b761ef7101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:13.178037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0dce2077-99c9-4a46-a9bb-c0b761ef7101 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:13.179386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0dce2077-99c9-4a46-a9bb-c0b761ef7101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:13.242876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1196/2375] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:13.310218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625a0e4-679b-4680-a3b7-b409d68a50b4 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:13.310507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625a0e4-679b-4680-a3b7-b409d68a50b4 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:13.310782 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625a0e4-679b-4680-a3b7-b409d68a50b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:13.329514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1625a0e4-679b-4680-a3b7-b409d68a50b4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:13.330905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1625a0e4-679b-4680-a3b7-b409d68a50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:13.339077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1180/2376] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:13.343490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2077-99c9-4a46-a9bb-c0b761ef7101 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:13.353901 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2077-99c9-4a46-a9bb-c0b761ef7101 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:13.358505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7758a8a-f59d-406d-bb2d-3b9dc49883a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:13.359233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758a8a-f59d-406d-bb2d-3b9dc49883a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:13.359544 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758a8a-f59d-406d-bb2d-3b9dc49883a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:13.359808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7758a8a-f59d-406d-bb2d-3b9dc49883a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:13.361152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7758a8a-f59d-406d-bb2d-3b9dc49883a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:16:13.361442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7758a8a-f59d-406d-bb2d-3b9dc49883a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:13.363003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7758a8a-f59d-406d-bb2d-3b9dc49883a1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:13.370842 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:13.379669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1197/2377] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:16:13.380999 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625a0e4-679b-4680-a3b7-b409d68a50b4 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:13.390053 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625a0e4-679b-4680-a3b7-b409d68a50b4 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:13.394761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae7c1-a5fe-481b-89a9-34964cb3643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:13.395413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae7c1-a5fe-481b-89a9-34964cb3643f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:13.395690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae7c1-a5fe-481b-89a9-34964cb3643f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:13.395959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae7c1-a5fe-481b-89a9-34964cb3643f admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:13.396660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae7c1-a5fe-481b-89a9-34964cb3643f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:13.398765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae7c1-a5fe-481b-89a9-34964cb3643f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:13.488171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1181/2378] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:16:13 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:16:13.492212 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7758a8a-f59d-406d-bb2d-3b9dc49883a1 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:13.502641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7758a8a-f59d-406d-bb2d-3b9dc49883a1 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:13.575263 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d174e3-4095-4a86-97e1-d410acff9d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:13.575980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d174e3-4095-4a86-97e1-d410acff9d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:13.576264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d174e3-4095-4a86-97e1-d410acff9d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:13.576540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d174e3-4095-4a86-97e1-d410acff9d06 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:13.577245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d174e3-4095-4a86-97e1-d410acff9d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:13.579944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d174e3-4095-4a86-97e1-d410acff9d06 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:13.663732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1198/2379] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:16:13 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:16:13.667842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae7c1-a5fe-481b-89a9-34964cb3643f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:13.678366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae7c1-a5fe-481b-89a9-34964cb3643f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:13.683246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd496de-7857-4526-a806-e0de19aede67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:13.683821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd496de-7857-4526-a806-e0de19aede67 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:13.684076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd496de-7857-4526-a806-e0de19aede67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:13.684376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd496de-7857-4526-a806-e0de19aede67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:13.685105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd496de-7857-4526-a806-e0de19aede67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:13.686685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd496de-7857-4526-a806-e0de19aede67 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:13.697153 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1182/2380] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:16:13.701070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d174e3-4095-4a86-97e1-d410acff9d06 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:13.711594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d174e3-4095-4a86-97e1-d410acff9d06 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:13.716361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1fe19-a774-4cdb-86ab-2ca7c1f9fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:13.717014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1fe19-a774-4cdb-86ab-2ca7c1f9fcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:13.717295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1fe19-a774-4cdb-86ab-2ca7c1f9fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:13.717568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1fe19-a774-4cdb-86ab-2ca7c1f9fcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:13.718286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1fe19-a774-4cdb-86ab-2ca7c1f9fcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:13.720615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1fe19-a774-4cdb-86ab-2ca7c1f9fcf8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:13.730397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1199/2381] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:16:13.734575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd496de-7857-4526-a806-e0de19aede67 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:13.744816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd496de-7857-4526-a806-e0de19aede67 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:13.749323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684de1a-0d2b-4596-8f8d-a55d6f77f170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:13.750187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684de1a-0d2b-4596-8f8d-a55d6f77f170 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:13.750467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684de1a-0d2b-4596-8f8d-a55d6f77f170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:13.750740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684de1a-0d2b-4596-8f8d-a55d6f77f170 admin admin] PATH_INFO: `/v3/projects/21c0abf697ed4e29870a594ed83de6c7/users/722fc8b42ea941499a56937ce0d8ad3a/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:13.764897 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684de1a-0d2b-4596-8f8d-a55d6f77f170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c0abf697ed4e29870a594ed83de6c7, user_id=722fc8b42ea941499a56937ce0d8ad3a, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:13.768080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684de1a-0d2b-4596-8f8d-a55d6f77f170 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:13.861776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1183/2382] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:16:13 2022] PUT /identity/v3/projects/21c0abf697ed4e29870a594ed83de6c7/users/722fc8b42ea941499a56937ce0d8ad3a/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:16:13.867235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11020d85-3171-40c3-878d-ed5082753352 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:13.867529 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11020d85-3171-40c3-878d-ed5082753352 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:13.868062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11020d85-3171-40c3-878d-ed5082753352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:13.886892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-11020d85-3171-40c3-878d-ed5082753352 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:13.888291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-11020d85-3171-40c3-878d-ed5082753352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:13.952896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1200/2383] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:13.963020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684de1a-0d2b-4596-8f8d-a55d6f77f170 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:13.964854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4684de1a-0d2b-4596-8f8d-a55d6f77f170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:14.023358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684de1a-0d2b-4596-8f8d-a55d6f77f170 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:14.027481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201738a7-8e14-4a06-b07b-5e32620227a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:14.028066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201738a7-8e14-4a06-b07b-5e32620227a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:14.028345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201738a7-8e14-4a06-b07b-5e32620227a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:14.028618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201738a7-8e14-4a06-b07b-5e32620227a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:14.039063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201738a7-8e14-4a06-b07b-5e32620227a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:14.040511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201738a7-8e14-4a06-b07b-5e32620227a8 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:14.050666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1184/2384] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:19.734612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffdb8c-73e0-471f-9059-710e3fbd482e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:19.735714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffdb8c-73e0-471f-9059-710e3fbd482e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:19.735714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffdb8c-73e0-471f-9059-710e3fbd482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:19.766835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1cffdb8c-73e0-471f-9059-710e3fbd482e None None] MFA Rules not processed for user `722fc8b42ea941499a56937ce0d8ad3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:19.768128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1cffdb8c-73e0-471f-9059-710e3fbd482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:19.833608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1201/2385] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:19.838647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201738a7-8e14-4a06-b07b-5e32620227a8 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:19.848134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201738a7-8e14-4a06-b07b-5e32620227a8 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:19.852719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3b55c-f25d-4828-84c8-7ae5f91adf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:19.853362 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3b55c-f25d-4828-84c8-7ae5f91adf9b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:19.853894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3b55c-f25d-4828-84c8-7ae5f91adf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:19.853894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3b55c-f25d-4828-84c8-7ae5f91adf9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:19.854569 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3b55c-f25d-4828-84c8-7ae5f91adf9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:19.856489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3b55c-f25d-4828-84c8-7ae5f91adf9b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:19.973387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1185/2386] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:16:19 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:16:19.978246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffdb8c-73e0-471f-9059-710e3fbd482e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:19.995375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffdb8c-73e0-471f-9059-710e3fbd482e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:19.999796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:20.053869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160e76-3e70-4d4b-921b-0d4afd3487d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:20.054483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160e76-3e70-4d4b-921b-0d4afd3487d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:20.054764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160e76-3e70-4d4b-921b-0d4afd3487d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:20.055037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160e76-3e70-4d4b-921b-0d4afd3487d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:20.057580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0160e76-3e70-4d4b-921b-0d4afd3487d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:20.059928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0160e76-3e70-4d4b-921b-0d4afd3487d9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:20.154561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1202/2387] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:16:19 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:16:20.159602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3b55c-f25d-4828-84c8-7ae5f91adf9b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:20.174078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3b55c-f25d-4828-84c8-7ae5f91adf9b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:20.178891 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aecb6e-07fc-49dd-bff3-80c867bfe5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:20.179591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aecb6e-07fc-49dd-bff3-80c867bfe5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:20.179873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aecb6e-07fc-49dd-bff3-80c867bfe5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:20.180147 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aecb6e-07fc-49dd-bff3-80c867bfe5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:20.180871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aecb6e-07fc-49dd-bff3-80c867bfe5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:20.182517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aecb6e-07fc-49dd-bff3-80c867bfe5f9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:20.194128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1186/2388] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:16:20.198412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160e76-3e70-4d4b-921b-0d4afd3487d9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:20.209654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160e76-3e70-4d4b-921b-0d4afd3487d9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:20.214534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556c62-c3ab-45e9-9e21-16d80967813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:20.220025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556c62-c3ab-45e9-9e21-16d80967813b admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:20.220025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556c62-c3ab-45e9-9e21-16d80967813b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:20.220025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556c62-c3ab-45e9-9e21-16d80967813b admin admin] PATH_INFO: `/v3/projects/cdc62cbe60f84cbda80e7f9831e627dd/users/4f3a7935830c46f6b0bd65e0bbf4d3b3/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:20.232910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd556c62-c3ab-45e9-9e21-16d80967813b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc62cbe60f84cbda80e7f9831e627dd, user_id=4f3a7935830c46f6b0bd65e0bbf4d3b3, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:20.235675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd556c62-c3ab-45e9-9e21-16d80967813b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:20.319447 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1203/2389] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:16:20 2022] PUT /identity/v3/projects/cdc62cbe60f84cbda80e7f9831e627dd/users/4f3a7935830c46f6b0bd65e0bbf4d3b3/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:16:20.323445 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aecb6e-07fc-49dd-bff3-80c867bfe5f9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:20.335748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aecb6e-07fc-49dd-bff3-80c867bfe5f9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:20.346236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:20.396595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02293766-c386-44dc-9357-70d03da78fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:20.397281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02293766-c386-44dc-9357-70d03da78fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:20.397557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02293766-c386-44dc-9357-70d03da78fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:20.397828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02293766-c386-44dc-9357-70d03da78fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:20.398539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02293766-c386-44dc-9357-70d03da78fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:20.400155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02293766-c386-44dc-9357-70d03da78fe5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:20.411478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1187/2390] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:16:20.415595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556c62-c3ab-45e9-9e21-16d80967813b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:20.426432 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556c62-c3ab-45e9-9e21-16d80967813b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:20.431068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55cf5-f582-4c65-bf39-bdc3c86ddc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:20.431986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55cf5-f582-4c65-bf39-bdc3c86ddc49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:20.432385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55cf5-f582-4c65-bf39-bdc3c86ddc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:20.432662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55cf5-f582-4c65-bf39-bdc3c86ddc49 admin admin] PATH_INFO: `/v3/projects/cdc62cbe60f84cbda80e7f9831e627dd/users/4f3a7935830c46f6b0bd65e0bbf4d3b3/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:20.434638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c55cf5-f582-4c65-bf39-bdc3c86ddc49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc62cbe60f84cbda80e7f9831e627dd, user_id=4f3a7935830c46f6b0bd65e0bbf4d3b3, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:20.437256 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c55cf5-f582-4c65-bf39-bdc3c86ddc49 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:20.447723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1204/2391] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:16:20 2022] PUT /identity/v3/projects/cdc62cbe60f84cbda80e7f9831e627dd/users/4f3a7935830c46f6b0bd65e0bbf4d3b3/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:25.787585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02293766-c386-44dc-9357-70d03da78fe5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:25.790009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-02293766-c386-44dc-9357-70d03da78fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:25.886426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02293766-c386-44dc-9357-70d03da78fe5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:25.964846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c50b79-2e75-4891-942c-3cac8827cecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:25.966404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c50b79-2e75-4891-942c-3cac8827cecc service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:25.968892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c50b79-2e75-4891-942c-3cac8827cecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:25.969229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c50b79-2e75-4891-942c-3cac8827cecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:25.972973 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-13c50b79-2e75-4891-942c-3cac8827cecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:26.087189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c50b79-2e75-4891-942c-3cac8827cecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:26.088636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c50b79-2e75-4891-942c-3cac8827cecc service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:26.100424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1188/2392] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:27.870713 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55cf5-f582-4c65-bf39-bdc3c86ddc49 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:27.872530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-76c55cf5-f582-4c65-bf39-bdc3c86ddc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:27.944721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55cf5-f582-4c65-bf39-bdc3c86ddc49 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:27.949930 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:27.950854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:27.951366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:27.951798 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] PATH_INFO: `/v3/users/10676d8039d84b2d968076b0c66183ce` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:27.953015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=10676d8039d84b2d968076b0c66183ce)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:27.955679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:28.136712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10676d8039d84b2d968076b0c66183ce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:28.137671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10676d8039d84b2d968076b0c66183ce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:28.138272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10676d8039d84b2d968076b0c66183ce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:28.153570 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:28.155524 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10676d8039d84b2d968076b0c66183ce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:28.162327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-eb0ce57e-4108-4cb6-90fa-20d66f8bfffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10676d8039d84b2d968076b0c66183ce'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:28.249208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1205/2393] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:16:27 2022] DELETE /identity/v3/users/10676d8039d84b2d968076b0c66183ce => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:28.251612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37bd1-e7a0-4259-9b08-88376b76ce9f None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:28.252085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37bd1-e7a0-4259-9b08-88376b76ce9f None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:28.252166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37bd1-e7a0-4259-9b08-88376b76ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:28.289523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d0f37bd1-e7a0-4259-9b08-88376b76ce9f None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:28.290866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d0f37bd1-e7a0-4259-9b08-88376b76ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:28.299694 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:28.337955 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe1d3-d231-4072-8c49-59d57c633e39 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:28.338244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe1d3-d231-4072-8c49-59d57c633e39 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:28.338518 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe1d3-d231-4072-8c49-59d57c633e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:28.376994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-22cbe1d3-d231-4072-8c49-59d57c633e39 None None] MFA Rules not processed for user `4f3a7935830c46f6b0bd65e0bbf4d3b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:28.378267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-22cbe1d3-d231-4072-8c49-59d57c633e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:28.432159 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1189/2394] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:28.451625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f37bd1-e7a0-4259-9b08-88376b76ce9f None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:28.454532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d0f37bd1-e7a0-4259-9b08-88376b76ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:28.518179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1206/2395] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:16:28.534484 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe1d3-d231-4072-8c49-59d57c633e39 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:28.536644 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-22cbe1d3-d231-4072-8c49-59d57c633e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:28.543399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f37bd1-e7a0-4259-9b08-88376b76ce9f None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:28.547856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33814319-4fb3-41db-9e80-74f8999bf4e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:28.548529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33814319-4fb3-41db-9e80-74f8999bf4e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:28.548815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33814319-4fb3-41db-9e80-74f8999bf4e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:28.549094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33814319-4fb3-41db-9e80-74f8999bf4e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:28.562047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33814319-4fb3-41db-9e80-74f8999bf4e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:28.564709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33814319-4fb3-41db-9e80-74f8999bf4e9 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:28.575934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1190/2396] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:28.685512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe1d3-d231-4072-8c49-59d57c633e39 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:28.694925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5494b2f-3d77-499f-96f9-7d5b7c0f4d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:28.695935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494b2f-3d77-499f-96f9-7d5b7c0f4d31 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:28.696293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494b2f-3d77-499f-96f9-7d5b7c0f4d31 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:28.696585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494b2f-3d77-499f-96f9-7d5b7c0f4d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:28.698533 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f5494b2f-3d77-499f-96f9-7d5b7c0f4d31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:28.748148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:28.779119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5494b2f-3d77-499f-96f9-7d5b7c0f4d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:28.782239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5494b2f-3d77-499f-96f9-7d5b7c0f4d31 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:28.792879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1207/2397] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:16:29.224761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33814319-4fb3-41db-9e80-74f8999bf4e9 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:29.226354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-33814319-4fb3-41db-9e80-74f8999bf4e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:29.241798 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33814319-4fb3-41db-9e80-74f8999bf4e9 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:29.252012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:29.252958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:29.253439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:29.253714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] PATH_INFO: `/v3/projects/86939fc2ddf745a68b73ae045daad92c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:29.255142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=86939fc2ddf745a68b73ae045daad92c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:29.257550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:29.392694 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86939fc2ddf745a68b73ae045daad92c', 'request_id': 'req-edb8840a-2668-4fa0-a369-8b92f09a0d1c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:29.399345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86939fc2ddf745a68b73ae045daad92c', 'request_id': 'req-edb8840a-2668-4fa0-a369-8b92f09a0d1c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:29.468709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86939fc2ddf745a68b73ae045daad92c', 'request_id': 'req-edb8840a-2668-4fa0-a369-8b92f09a0d1c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:29.485490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] The token cache is being invalidate because project 86939fc2ddf745a68b73ae045daad92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:16:29.485794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:29.486530 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-edb8840a-2668-4fa0-a369-8b92f09a0d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:29.491617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1191/2398] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:16:29 2022] DELETE /identity/v3/projects/86939fc2ddf745a68b73ae045daad92c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:29.501723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad1b9a-843a-447a-9749-22e14a5fa6b0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:29.501723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad1b9a-843a-447a-9749-22e14a5fa6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:29.501723 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad1b9a-843a-447a-9749-22e14a5fa6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:29.519319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-27ad1b9a-843a-447a-9749-22e14a5fa6b0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:29.520271 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-27ad1b9a-843a-447a-9749-22e14a5fa6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:29.595954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1208/2399] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:29.598306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14538073-cde8-49ba-9b6c-7ba9cbcccc4b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:29.598662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14538073-cde8-49ba-9b6c-7ba9cbcccc4b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:29.598994 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14538073-cde8-49ba-9b6c-7ba9cbcccc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:29.622918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-14538073-cde8-49ba-9b6c-7ba9cbcccc4b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:29.624403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-14538073-cde8-49ba-9b6c-7ba9cbcccc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:29.637415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1192/2400] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:29.639326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad1b9a-843a-447a-9749-22e14a5fa6b0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:29.652639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad1b9a-843a-447a-9749-22e14a5fa6b0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:29.659564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235b6a5-ffd5-4625-a936-d2e90922ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:29.659964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235b6a5-ffd5-4625-a936-d2e90922ce75 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:29.660398 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235b6a5-ffd5-4625-a936-d2e90922ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:29.661437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235b6a5-ffd5-4625-a936-d2e90922ce75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:29.662223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235b6a5-ffd5-4625-a936-d2e90922ce75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:16:29.662536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235b6a5-ffd5-4625-a936-d2e90922ce75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:29.664236 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235b6a5-ffd5-4625-a936-d2e90922ce75 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:29.680370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1209/2401] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:16:29.682574 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14538073-cde8-49ba-9b6c-7ba9cbcccc4b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:29.695016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14538073-cde8-49ba-9b6c-7ba9cbcccc4b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:29.701045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb70bb-6bd9-486e-8fd1-485e3f79c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:29.701820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb70bb-6bd9-486e-8fd1-485e3f79c53d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:29.702196 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb70bb-6bd9-486e-8fd1-485e3f79c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:29.702689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb70bb-6bd9-486e-8fd1-485e3f79c53d admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:29.704155 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb70bb-6bd9-486e-8fd1-485e3f79c53d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:29.706194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb70bb-6bd9-486e-8fd1-485e3f79c53d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:29.830363 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1193/2402] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:16:29 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:16:29.834536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235b6a5-ffd5-4625-a936-d2e90922ce75 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:29.847308 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235b6a5-ffd5-4625-a936-d2e90922ce75 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:29.923939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a4502-bb83-4ca8-8e4a-03c52af4bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:29.924965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4502-bb83-4ca8-8e4a-03c52af4bb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:29.925332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4502-bb83-4ca8-8e4a-03c52af4bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:29.925705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4502-bb83-4ca8-8e4a-03c52af4bb5d admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:29.926441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a4502-bb83-4ca8-8e4a-03c52af4bb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:29.928736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a4502-bb83-4ca8-8e4a-03c52af4bb5d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:30.054149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1210/2403] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:16:29 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:16:30.055757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb70bb-6bd9-486e-8fd1-485e3f79c53d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:30.067212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb70bb-6bd9-486e-8fd1-485e3f79c53d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:30.072343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc67e-3a43-4794-8e5a-6e6ce00b60d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:30.073236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc67e-3a43-4794-8e5a-6e6ce00b60d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:30.073519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc67e-3a43-4794-8e5a-6e6ce00b60d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:30.073818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc67e-3a43-4794-8e5a-6e6ce00b60d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:30.074561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc67e-3a43-4794-8e5a-6e6ce00b60d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:30.076241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc67e-3a43-4794-8e5a-6e6ce00b60d8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:30.083368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:30.091691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1194/2404] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:16:30.092977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a4502-bb83-4ca8-8e4a-03c52af4bb5d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:30.104792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a4502-bb83-4ca8-8e4a-03c52af4bb5d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:30.109886 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adfbd0-5e4f-4b4b-8a3b-0fb7b7825c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:30.111380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adfbd0-5e4f-4b4b-8a3b-0fb7b7825c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:30.111380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adfbd0-5e4f-4b4b-8a3b-0fb7b7825c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:30.111380 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adfbd0-5e4f-4b4b-8a3b-0fb7b7825c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:30.112630 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adfbd0-5e4f-4b4b-8a3b-0fb7b7825c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:30.114216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adfbd0-5e4f-4b4b-8a3b-0fb7b7825c8d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:30.132156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc67e-3a43-4794-8e5a-6e6ce00b60d8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:30.137828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1211/2405] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:16:30.149187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc67e-3a43-4794-8e5a-6e6ce00b60d8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:30.159204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083384e0-9d0f-4e2c-8251-61f60b31eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:30.161459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083384e0-9d0f-4e2c-8251-61f60b31eadb admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:30.162249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083384e0-9d0f-4e2c-8251-61f60b31eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:30.162743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083384e0-9d0f-4e2c-8251-61f60b31eadb admin admin] PATH_INFO: `/v3/projects/520be3417a7047ef81cac4db926f3f20/users/929db9b6452f46ff9b854efb4a0d464a/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:30.205649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083384e0-9d0f-4e2c-8251-61f60b31eadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=520be3417a7047ef81cac4db926f3f20, user_id=929db9b6452f46ff9b854efb4a0d464a, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:30.210590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083384e0-9d0f-4e2c-8251-61f60b31eadb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:30.286092 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1195/2406] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:16:30 2022] PUT /identity/v3/projects/520be3417a7047ef81cac4db926f3f20/users/929db9b6452f46ff9b854efb4a0d464a/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:30.287931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7436312-8d2b-44a6-b0f7-cf7ed8d99f97 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:30.288209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7436312-8d2b-44a6-b0f7-cf7ed8d99f97 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:30.288486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7436312-8d2b-44a6-b0f7-cf7ed8d99f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:30.311889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e7436312-8d2b-44a6-b0f7-cf7ed8d99f97 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:30.313696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e7436312-8d2b-44a6-b0f7-cf7ed8d99f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:30.373990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:30.403029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1212/2407] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:30.412840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083384e0-9d0f-4e2c-8251-61f60b31eadb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:30.414789 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-083384e0-9d0f-4e2c-8251-61f60b31eadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:30.494857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083384e0-9d0f-4e2c-8251-61f60b31eadb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:30.499219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aeeaa-3d8c-46a1-b90d-34ee7655206c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:30.499903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aeeaa-3d8c-46a1-b90d-34ee7655206c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:30.500812 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aeeaa-3d8c-46a1-b90d-34ee7655206c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:30.501145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aeeaa-3d8c-46a1-b90d-34ee7655206c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:30.511760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aeeaa-3d8c-46a1-b90d-34ee7655206c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:30.513263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aeeaa-3d8c-46a1-b90d-34ee7655206c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:30.531061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1196/2408] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:32.154592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7436312-8d2b-44a6-b0f7-cf7ed8d99f97 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:32.156138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e7436312-8d2b-44a6-b0f7-cf7ed8d99f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:32.169680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7436312-8d2b-44a6-b0f7-cf7ed8d99f97 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:32.175075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:32.176114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:32.176464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:32.176870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] PATH_INFO: `/v3/users/18da5125d3b64a5e9f1e9e1d6f2374b6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:32.183399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18da5125d3b64a5e9f1e9e1d6f2374b6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:32.183399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:32.434417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18da5125d3b64a5e9f1e9e1d6f2374b6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:32.435905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18da5125d3b64a5e9f1e9e1d6f2374b6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:32.436526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18da5125d3b64a5e9f1e9e1d6f2374b6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:32.456575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18da5125d3b64a5e9f1e9e1d6f2374b6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:32.469424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18da5125d3b64a5e9f1e9e1d6f2374b6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:32.553519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1213/2409] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:16:32 2022] DELETE /identity/v3/users/18da5125d3b64a5e9f1e9e1d6f2374b6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:32.558488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115e006-f7d0-407c-b3df-64bc002c5b44 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:32.559395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115e006-f7d0-407c-b3df-64bc002c5b44 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:32.565408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115e006-f7d0-407c-b3df-64bc002c5b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:32.584300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9115e006-f7d0-407c-b3df-64bc002c5b44 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:32.585707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9115e006-f7d0-407c-b3df-64bc002c5b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:32.700108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1197/2410] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:32.707573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:32.709218 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:32.799985 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90831714-01e4-40fd-ab7e-ae4d08644be7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:32.808231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802fb7c-7475-418d-898f-a3f6bc7aebaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:32.813034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fb7c-7475-418d-898f-a3f6bc7aebaf service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:32.813034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fb7c-7475-418d-898f-a3f6bc7aebaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:32.813034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fb7c-7475-418d-898f-a3f6bc7aebaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:32.824155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802fb7c-7475-418d-898f-a3f6bc7aebaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:32.826588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802fb7c-7475-418d-898f-a3f6bc7aebaf service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:32.847283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1214/2411] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:33.496657 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115e006-f7d0-407c-b3df-64bc002c5b44 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:33.498101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9115e006-f7d0-407c-b3df-64bc002c5b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:33.511652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115e006-f7d0-407c-b3df-64bc002c5b44 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:33.518737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:33.522309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:33.522309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:33.522309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] PATH_INFO: `/v3/projects/58d4f4f6743746a998c2a962b7126b23` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:33.522864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d4f4f6743746a998c2a962b7126b23)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:33.525102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:33.668393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d4f4f6743746a998c2a962b7126b23', 'request_id': 'req-ffac508c-cbde-4458-97e6-db3bea45e3cf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:33.676834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d4f4f6743746a998c2a962b7126b23', 'request_id': 'req-ffac508c-cbde-4458-97e6-db3bea45e3cf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:33.771915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d4f4f6743746a998c2a962b7126b23', 'request_id': 'req-ffac508c-cbde-4458-97e6-db3bea45e3cf'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:33.791186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] The token cache is being invalidate because project 58d4f4f6743746a998c2a962b7126b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:16:33.792289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:33.795303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ffac508c-cbde-4458-97e6-db3bea45e3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:16:33.802906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1198/2412] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:16:33 2022] DELETE /identity/v3/projects/58d4f4f6743746a998c2a962b7126b23 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:33.807664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ba965-3b3a-4d74-bd71-725a34b53ba4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:33.808559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ba965-3b3a-4d74-bd71-725a34b53ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:33.809002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ba965-3b3a-4d74-bd71-725a34b53ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:33.840011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-aa6ba965-3b3a-4d74-bd71-725a34b53ba4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:33.840011 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-aa6ba965-3b3a-4d74-bd71-725a34b53ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:33.943056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:34.001526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1215/2413] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:34.009410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df7a75-6879-459d-abd2-ed59f428337c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:34.010823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df7a75-6879-459d-abd2-ed59f428337c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:34.011210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df7a75-6879-459d-abd2-ed59f428337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:34.020447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:34.056676 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-00df7a75-6879-459d-abd2-ed59f428337c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:34.061172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-00df7a75-6879-459d-abd2-ed59f428337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:34.086911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1199/2414] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:34.087638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ba965-3b3a-4d74-bd71-725a34b53ba4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:34.097815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ba965-3b3a-4d74-bd71-725a34b53ba4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:34.115952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73240f0-7051-4b7d-9dda-655f8afdb802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:34.116639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73240f0-7051-4b7d-9dda-655f8afdb802 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:34.116921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73240f0-7051-4b7d-9dda-655f8afdb802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:34.117444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73240f0-7051-4b7d-9dda-655f8afdb802 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:34.118188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73240f0-7051-4b7d-9dda-655f8afdb802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:16:34.118490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73240f0-7051-4b7d-9dda-655f8afdb802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:34.120330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73240f0-7051-4b7d-9dda-655f8afdb802 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:34.151526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1216/2415] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:16:34.153670 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df7a75-6879-459d-abd2-ed59f428337c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:34.177693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df7a75-6879-459d-abd2-ed59f428337c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:34.197247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c80f8-f9e0-444e-b22a-d557387d8640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:34.198178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c80f8-f9e0-444e-b22a-d557387d8640 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:34.198671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c80f8-f9e0-444e-b22a-d557387d8640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:34.199258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c80f8-f9e0-444e-b22a-d557387d8640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:34.200184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c80f8-f9e0-444e-b22a-d557387d8640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:34.202651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c80f8-f9e0-444e-b22a-d557387d8640 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:34.341988 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1200/2416] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:16:34 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:16:34.342294 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73240f0-7051-4b7d-9dda-655f8afdb802 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:34.369989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73240f0-7051-4b7d-9dda-655f8afdb802 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:34.567447 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb792d-0ac6-4db1-b5c3-59c76f2a7792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:34.568151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb792d-0ac6-4db1-b5c3-59c76f2a7792 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:34.568428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb792d-0ac6-4db1-b5c3-59c76f2a7792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:34.568703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb792d-0ac6-4db1-b5c3-59c76f2a7792 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:34.569396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb792d-0ac6-4db1-b5c3-59c76f2a7792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:34.575775 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb792d-0ac6-4db1-b5c3-59c76f2a7792 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:34.740836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1217/2417] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:16:34 2022] POST /identity/v3/users => generated 288 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:16:34.745257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c80f8-f9e0-444e-b22a-d557387d8640 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:34.761377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c80f8-f9e0-444e-b22a-d557387d8640 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:34.778792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8110b-b406-412e-9f39-01f9f0b20a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:34.779919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8110b-b406-412e-9f39-01f9f0b20a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:34.780414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8110b-b406-412e-9f39-01f9f0b20a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:34.780895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8110b-b406-412e-9f39-01f9f0b20a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:34.781919 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8110b-b406-412e-9f39-01f9f0b20a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:34.784595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8110b-b406-412e-9f39-01f9f0b20a3d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:34.820161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb792d-0ac6-4db1-b5c3-59c76f2a7792 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:34.822830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1201/2418] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:16:34.834313 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb792d-0ac6-4db1-b5c3-59c76f2a7792 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:34.863930 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708e6e-4768-41e4-a3c9-1a1e294c4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:34.865023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708e6e-4768-41e4-a3c9-1a1e294c4978 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:34.866044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708e6e-4768-41e4-a3c9-1a1e294c4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:34.866532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708e6e-4768-41e4-a3c9-1a1e294c4978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:34.868028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708e6e-4768-41e4-a3c9-1a1e294c4978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:34.869997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708e6e-4768-41e4-a3c9-1a1e294c4978 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:34.901999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1218/2419] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:16:34.906880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8110b-b406-412e-9f39-01f9f0b20a3d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:34.925039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8110b-b406-412e-9f39-01f9f0b20a3d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:34.935415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aea86-dc5e-45c1-abaa-9f2d15252d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:34.936623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aea86-dc5e-45c1-abaa-9f2d15252d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:34.938197 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aea86-dc5e-45c1-abaa-9f2d15252d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:34.938698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aea86-dc5e-45c1-abaa-9f2d15252d2c admin admin] PATH_INFO: `/v3/projects/715419f2d81e4b589c011b067900fabe/users/69cdc4db9e7946cbac4116fdf9425661/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:34.958047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aea86-dc5e-45c1-abaa-9f2d15252d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=715419f2d81e4b589c011b067900fabe, user_id=69cdc4db9e7946cbac4116fdf9425661, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:34.964170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aea86-dc5e-45c1-abaa-9f2d15252d2c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:35.055775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1202/2420] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:16:34 2022] PUT /identity/v3/projects/715419f2d81e4b589c011b067900fabe/users/69cdc4db9e7946cbac4116fdf9425661/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:16:35.134593 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bd270-5ce5-4b72-924c-335e24b7e4b0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:35.140540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bd270-5ce5-4b72-924c-335e24b7e4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:35.140540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bd270-5ce5-4b72-924c-335e24b7e4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:35.188209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2d7bd270-5ce5-4b72-924c-335e24b7e4b0 None None] MFA Rules not processed for user `69cdc4db9e7946cbac4116fdf9425661`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:35.192552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2d7bd270-5ce5-4b72-924c-335e24b7e4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:35.300908 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1219/2421] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:35.312382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aea86-dc5e-45c1-abaa-9f2d15252d2c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:35.314709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-be0aea86-dc5e-45c1-abaa-9f2d15252d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:35.596367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aea86-dc5e-45c1-abaa-9f2d15252d2c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:35.596367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273405a-badb-4194-8629-a1903028ed4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:35.596367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273405a-badb-4194-8629-a1903028ed4f service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:35.596367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273405a-badb-4194-8629-a1903028ed4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:35.597440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273405a-badb-4194-8629-a1903028ed4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:35.597440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273405a-badb-4194-8629-a1903028ed4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:35.597440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273405a-badb-4194-8629-a1903028ed4f service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:35.597440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1203/2422] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:37.592296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4024f39-e7a3-4952-aa57-e1ba9d80f471 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:37.593196 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4024f39-e7a3-4952-aa57-e1ba9d80f471 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:37.594292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4024f39-e7a3-4952-aa57-e1ba9d80f471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:37.619511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a4024f39-e7a3-4952-aa57-e1ba9d80f471 None None] MFA Rules not processed for user `69cdc4db9e7946cbac4116fdf9425661`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:37.620957 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a4024f39-e7a3-4952-aa57-e1ba9d80f471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:37.630624 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1220/2423] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:16:37.859956 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab95e95-e4a4-471c-a962-e97a263ec8a7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:37.860514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab95e95-e4a4-471c-a962-e97a263ec8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:37.860776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab95e95-e4a4-471c-a962-e97a263ec8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:37.909456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dab95e95-e4a4-471c-a962-e97a263ec8a7 None None] MFA Rules not processed for user `929db9b6452f46ff9b854efb4a0d464a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:37.911068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dab95e95-e4a4-471c-a962-e97a263ec8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:37.994575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1204/2424] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:37.998759 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4024f39-e7a3-4952-aa57-e1ba9d80f471 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:38.000811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a4024f39-e7a3-4952-aa57-e1ba9d80f471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:38.064129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:38.089290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4024f39-e7a3-4952-aa57-e1ba9d80f471 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:38.094269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48725d-ffaa-4adc-b5c8-9df37d463121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:38.095216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48725d-ffaa-4adc-b5c8-9df37d463121 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:38.095437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48725d-ffaa-4adc-b5c8-9df37d463121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:38.095928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48725d-ffaa-4adc-b5c8-9df37d463121 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:38.097197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48725d-ffaa-4adc-b5c8-9df37d463121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:38.099287 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48725d-ffaa-4adc-b5c8-9df37d463121 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:38.192395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1221/2425] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:16:37 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:16:38.195416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab95e95-e4a4-471c-a962-e97a263ec8a7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:38.206858 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab95e95-e4a4-471c-a962-e97a263ec8a7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:38.239200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:38.271477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bced-af2c-46de-b2a8-4f6909f684bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:38.272482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bced-af2c-46de-b2a8-4f6909f684bd admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:38.272962 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bced-af2c-46de-b2a8-4f6909f684bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:38.273247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bced-af2c-46de-b2a8-4f6909f684bd admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:38.274072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84bced-af2c-46de-b2a8-4f6909f684bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:38.276064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84bced-af2c-46de-b2a8-4f6909f684bd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:38.405170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1205/2426] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:16:38 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:16:38.409845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48725d-ffaa-4adc-b5c8-9df37d463121 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:38.420637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48725d-ffaa-4adc-b5c8-9df37d463121 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:38.425574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7002bbf-35ef-4975-8882-5e9c6dec9c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:38.426250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7002bbf-35ef-4975-8882-5e9c6dec9c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:38.426531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7002bbf-35ef-4975-8882-5e9c6dec9c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:38.427520 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7002bbf-35ef-4975-8882-5e9c6dec9c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:38.428714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7002bbf-35ef-4975-8882-5e9c6dec9c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:38.430905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7002bbf-35ef-4975-8882-5e9c6dec9c4f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:38.443977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1222/2427] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:16:38.448102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bced-af2c-46de-b2a8-4f6909f684bd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:38.461222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bced-af2c-46de-b2a8-4f6909f684bd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:38.466315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695da7-2dee-4fc8-ac23-1a17963b0eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:38.467242 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695da7-2dee-4fc8-ac23-1a17963b0eed admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:38.467525 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695da7-2dee-4fc8-ac23-1a17963b0eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:38.467799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695da7-2dee-4fc8-ac23-1a17963b0eed admin admin] PATH_INFO: `/v3/projects/72ebda3c71fa4afdb922c731d602614d/users/40335a26e6a247019043a2c3d18b492f/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:38.484251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0695da7-2dee-4fc8-ac23-1a17963b0eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ebda3c71fa4afdb922c731d602614d, user_id=40335a26e6a247019043a2c3d18b492f, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:38.486935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0695da7-2dee-4fc8-ac23-1a17963b0eed admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:38.549546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1206/2428] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:16:38 2022] PUT /identity/v3/projects/72ebda3c71fa4afdb922c731d602614d/users/40335a26e6a247019043a2c3d18b492f/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:38.553445 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7002bbf-35ef-4975-8882-5e9c6dec9c4f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:38.564375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7002bbf-35ef-4975-8882-5e9c6dec9c4f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:38.624449 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02070c2-6de7-409c-9b03-dfeb9bd2e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:38.625679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02070c2-6de7-409c-9b03-dfeb9bd2e834 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:38.625995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02070c2-6de7-409c-9b03-dfeb9bd2e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:38.626282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02070c2-6de7-409c-9b03-dfeb9bd2e834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:38.627172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02070c2-6de7-409c-9b03-dfeb9bd2e834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:38.628752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02070c2-6de7-409c-9b03-dfeb9bd2e834 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:38.639358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1223/2429] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:16:38.644206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695da7-2dee-4fc8-ac23-1a17963b0eed admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:38.655006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695da7-2dee-4fc8-ac23-1a17963b0eed admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:38.660879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cfe34-8894-4cfa-8438-3e19ea3497eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:38.661810 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cfe34-8894-4cfa-8438-3e19ea3497eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:38.662090 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cfe34-8894-4cfa-8438-3e19ea3497eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:38.662359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cfe34-8894-4cfa-8438-3e19ea3497eb admin admin] PATH_INFO: `/v3/projects/72ebda3c71fa4afdb922c731d602614d/users/40335a26e6a247019043a2c3d18b492f/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:38.664360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cfe34-8894-4cfa-8438-3e19ea3497eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ebda3c71fa4afdb922c731d602614d, user_id=40335a26e6a247019043a2c3d18b492f, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:38.667346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cfe34-8894-4cfa-8438-3e19ea3497eb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:38.678604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1207/2430] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:16:38 2022] PUT /identity/v3/projects/72ebda3c71fa4afdb922c731d602614d/users/40335a26e6a247019043a2c3d18b492f/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:16:45.939555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd3b3-78cd-4063-b7dd-a6b5fc01183f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:45.940035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd3b3-78cd-4063-b7dd-a6b5fc01183f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:45.940129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd3b3-78cd-4063-b7dd-a6b5fc01183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:45.967127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8d6dd3b3-78cd-4063-b7dd-a6b5fc01183f None None] MFA Rules not processed for user `40335a26e6a247019043a2c3d18b492f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:45.968388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8d6dd3b3-78cd-4063-b7dd-a6b5fc01183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:46.044975 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1224/2431] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:46.059029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cfe34-8894-4cfa-8438-3e19ea3497eb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:46.060832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ea8cfe34-8894-4cfa-8438-3e19ea3497eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:46.134661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cfe34-8894-4cfa-8438-3e19ea3497eb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:46.140078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54dd3f-d8bf-4dc8-b687-335ae99ace63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:46.140741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54dd3f-d8bf-4dc8-b687-335ae99ace63 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:46.141018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54dd3f-d8bf-4dc8-b687-335ae99ace63 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:46.141290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54dd3f-d8bf-4dc8-b687-335ae99ace63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:46.196070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54dd3f-d8bf-4dc8-b687-335ae99ace63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:46.197655 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54dd3f-d8bf-4dc8-b687-335ae99ace63 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:46.206954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1208/2432] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:49.022451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3fd8f-6d26-4f7f-85ae-11f638846d35 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:49.022907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3fd8f-6d26-4f7f-85ae-11f638846d35 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:49.023000 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3fd8f-6d26-4f7f-85ae-11f638846d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:49.048730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b9c3fd8f-6d26-4f7f-85ae-11f638846d35 None None] MFA Rules not processed for user `929db9b6452f46ff9b854efb4a0d464a`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:49.050116 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b9c3fd8f-6d26-4f7f-85ae-11f638846d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:49.057434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1225/2433] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:16:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:56.202634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:59.044083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:59.616284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324381-495c-4448-a65f-7ba32d6d381d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:59.617070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324381-495c-4448-a65f-7ba32d6d381d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:59.617070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324381-495c-4448-a65f-7ba32d6d381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:59.668163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-a5324381-495c-4448-a65f-7ba32d6d381d None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:59.669374 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a5324381-495c-4448-a65f-7ba32d6d381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:59.733646 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1209/2434] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:59.774004 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3fd8f-6d26-4f7f-85ae-11f638846d35 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:59.775433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b9c3fd8f-6d26-4f7f-85ae-11f638846d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:59.869521 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3fd8f-6d26-4f7f-85ae-11f638846d35 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:59.874547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad18b71-6e73-449e-a291-6160852fef6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:59.875223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad18b71-6e73-449e-a291-6160852fef6a service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:59.875502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad18b71-6e73-449e-a291-6160852fef6a service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:59.875776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad18b71-6e73-449e-a291-6160852fef6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:59.884437 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad18b71-6e73-449e-a291-6160852fef6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:59.886009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad18b71-6e73-449e-a291-6160852fef6a service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:59.894085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1226/2435] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:16:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 10:17:00.322112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0f9c3-dadb-47a1-9daa-986e55e3baf0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:00.322604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0f9c3-dadb-47a1-9daa-986e55e3baf0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:00.322954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0f9c3-dadb-47a1-9daa-986e55e3baf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:00.342769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cde0f9c3-dadb-47a1-9daa-986e55e3baf0 None None] MFA Rules not processed for user `722fc8b42ea941499a56937ce0d8ad3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:00.344031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cde0f9c3-dadb-47a1-9daa-986e55e3baf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:00.406615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1210/2436] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:17:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:17:00.770588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e9c4-9b9e-4735-946e-881bee168c91 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:00.771461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e9c4-9b9e-4735-946e-881bee168c91 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:00.771748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e9c4-9b9e-4735-946e-881bee168c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:00.789934 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-2445e9c4-9b9e-4735-946e-881bee168c91 None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:00.791431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2445e9c4-9b9e-4735-946e-881bee168c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:00.803253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1227/2437] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 2 10:17:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:00.814235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0f9c3-dadb-47a1-9daa-986e55e3baf0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:00.836767 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0f9c3-dadb-47a1-9daa-986e55e3baf0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:00.842853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cfef9-f897-4602-9021-b71aeb59c897 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:00.843631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cfef9-f897-4602-9021-b71aeb59c897 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:00.844604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cfef9-f897-4602-9021-b71aeb59c897 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:00.844887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cfef9-f897-4602-9021-b71aeb59c897 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:00.855564 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cfef9-f897-4602-9021-b71aeb59c897 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:00.857173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cfef9-f897-4602-9021-b71aeb59c897 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:00.867007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1211/2438] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:17:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:17:01.657080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6dea-1b9e-4382-bb5c-916d1f80d9fe None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:01.657384 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6dea-1b9e-4382-bb5c-916d1f80d9fe None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:01.657670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6dea-1b9e-4382-bb5c-916d1f80d9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:01.687696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-243a6dea-1b9e-4382-bb5c-916d1f80d9fe None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:01.689400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-243a6dea-1b9e-4382-bb5c-916d1f80d9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:01.697636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1228/2439] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:17:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:01.711602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cfef9-f897-4602-9021-b71aeb59c897 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:01.722721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cfef9-f897-4602-9021-b71aeb59c897 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:01.728971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38ab6b-9c6e-4abf-8cae-64239dbe0b99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:01.729704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38ab6b-9c6e-4abf-8cae-64239dbe0b99 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:01.730060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38ab6b-9c6e-4abf-8cae-64239dbe0b99 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:01.730407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38ab6b-9c6e-4abf-8cae-64239dbe0b99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:01.739303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38ab6b-9c6e-4abf-8cae-64239dbe0b99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:01.741083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38ab6b-9c6e-4abf-8cae-64239dbe0b99 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:01.749833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1212/2440] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:17:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:17:02.380514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312f220-1e2a-4113-9151-8fcd70ae1977 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:02.380514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312f220-1e2a-4113-9151-8fcd70ae1977 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:02.380514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312f220-1e2a-4113-9151-8fcd70ae1977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:02.398010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d312f220-1e2a-4113-9151-8fcd70ae1977 None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:02.399167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d312f220-1e2a-4113-9151-8fcd70ae1977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:02.408320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1229/2441] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 2 10:17:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:02.421252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38ab6b-9c6e-4abf-8cae-64239dbe0b99 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:02.432660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38ab6b-9c6e-4abf-8cae-64239dbe0b99 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:02.438210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c0d6-5c15-4ad7-a6fa-4ce03b50e3e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:02.438687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c0d6-5c15-4ad7-a6fa-4ce03b50e3e5 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:02.438968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c0d6-5c15-4ad7-a6fa-4ce03b50e3e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:02.439270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c0d6-5c15-4ad7-a6fa-4ce03b50e3e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:02.448262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1c0d6-5c15-4ad7-a6fa-4ce03b50e3e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:02.450005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1c0d6-5c15-4ad7-a6fa-4ce03b50e3e5 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:02.458584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1213/2442] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:17:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:17:05.230783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312f220-1e2a-4113-9151-8fcd70ae1977 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:05.331791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312f220-1e2a-4113-9151-8fcd70ae1977 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:05.338277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:05.341879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:05.341879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:05.341879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] PATH_INFO: `/v3/users/69cdc4db9e7946cbac4116fdf9425661` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:05.341879 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cdc4db9e7946cbac4116fdf9425661)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:05.343998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:05.630407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cdc4db9e7946cbac4116fdf9425661'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:05.631164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cdc4db9e7946cbac4116fdf9425661'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:05.632431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cdc4db9e7946cbac4116fdf9425661'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:05.637268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:05.647450 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cdc4db9e7946cbac4116fdf9425661'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:05.655233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cdc4db9e7946cbac4116fdf9425661'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:05.737415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1230/2443] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:17:05 2022] DELETE /identity/v3/users/69cdc4db9e7946cbac4116fdf9425661 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:17:05.742780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabf6da-adee-4649-aae2-ea1c6f375001 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:05.743295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabf6da-adee-4649-aae2-ea1c6f375001 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:05.743599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabf6da-adee-4649-aae2-ea1c6f375001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:05.765458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3cabf6da-adee-4649-aae2-ea1c6f375001 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:05.767119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3cabf6da-adee-4649-aae2-ea1c6f375001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:05.810987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:05.839438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1214/2444] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:05.849111 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:05.850545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:05.910400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a3676-2ae9-47a6-86a7-86572d0d0dc2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:05.914246 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75149e-bc10-479e-b67f-7c335d9acf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:05.914919 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75149e-bc10-479e-b67f-7c335d9acf32 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:05.915275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75149e-bc10-479e-b67f-7c335d9acf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:05.915555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75149e-bc10-479e-b67f-7c335d9acf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:05.926455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75149e-bc10-479e-b67f-7c335d9acf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:05.928001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75149e-bc10-479e-b67f-7c335d9acf32 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:05.938387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1231/2445] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:17:06.252431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabf6da-adee-4649-aae2-ea1c6f375001 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:06.254378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3cabf6da-adee-4649-aae2-ea1c6f375001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:06.266936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabf6da-adee-4649-aae2-ea1c6f375001 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:06.272596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:06.273466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:06.273798 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:06.274073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] PATH_INFO: `/v3/projects/715419f2d81e4b589c011b067900fabe` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:06.275306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715419f2d81e4b589c011b067900fabe)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:06.277315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:06.490617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715419f2d81e4b589c011b067900fabe', 'request_id': 'req-66f51e8e-c639-477b-aa2c-5b916ab63a13'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:06.493376 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715419f2d81e4b589c011b067900fabe', 'request_id': 'req-66f51e8e-c639-477b-aa2c-5b916ab63a13'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:06.728779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715419f2d81e4b589c011b067900fabe', 'request_id': 'req-66f51e8e-c639-477b-aa2c-5b916ab63a13'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:06.740380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] The token cache is being invalidate because project 715419f2d81e4b589c011b067900fabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:17:06.740717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:06.741355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:06.743205 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1215/2446] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:17:06 2022] DELETE /identity/v3/projects/715419f2d81e4b589c011b067900fabe => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:17:15.401517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1335e3-d27f-400e-8339-b624a79afc7d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:15.401981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1335e3-d27f-400e-8339-b624a79afc7d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:15.402083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1335e3-d27f-400e-8339-b624a79afc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:15.419326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-5f1335e3-d27f-400e-8339-b624a79afc7d None None] MFA Rules not processed for user `0514d3b22d94435196f8bf1eff26699e`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:15.420547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-5f1335e3-d27f-400e-8339-b624a79afc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:15.474718 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1232/2447] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:17:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:16.737130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:23.151256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:23.152790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:23.210596 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f51e8e-c639-477b-aa2c-5b916ab63a13 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:23.214475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880a80a-2438-4e16-8c4c-066e9c8648b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:23.215154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880a80a-2438-4e16-8c4c-066e9c8648b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:23.215439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880a80a-2438-4e16-8c4c-066e9c8648b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:23.215736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880a80a-2438-4e16-8c4c-066e9c8648b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:23.217510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2880a80a-2438-4e16-8c4c-066e9c8648b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:23.284968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880a80a-2438-4e16-8c4c-066e9c8648b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:23.286436 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880a80a-2438-4e16-8c4c-066e9c8648b4 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:23.296245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1216/2448] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:25.467935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=3,keystone:SELECT=61,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:33.291823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=50 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:41.448543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1335e3-d27f-400e-8339-b624a79afc7d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:41.458583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1335e3-d27f-400e-8339-b624a79afc7d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:41.462151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:41.462785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:41.463067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:41.463369 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:41.465112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:41.528176 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:41.529599 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:41.539156 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1233/2449] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:51.534889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=30 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:54.319325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2231b-c6b7-4c08-af4c-c4d6e662fa82 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:54.319822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2231b-c6b7-4c08-af4c-c4d6e662fa82 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:54.319931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2231b-c6b7-4c08-af4c-c4d6e662fa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:54.338286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0fd2231b-c6b7-4c08-af4c-c4d6e662fa82 None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:54.339427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0fd2231b-c6b7-4c08-af4c-c4d6e662fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:54.396479 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1217/2450] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:17:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:54.408375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:54.409767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:54.477142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500b328-ea4e-4e21-8f9b-1390cee477f4 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:54.482126 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6d1cc-fee1-4e74-98c4-bbff459e9eb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:54.482766 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6d1cc-fee1-4e74-98c4-bbff459e9eb9 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:54.483051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6d1cc-fee1-4e74-98c4-bbff459e9eb9 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:54.483359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6d1cc-fee1-4e74-98c4-bbff459e9eb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:54.491491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6d1cc-fee1-4e74-98c4-bbff459e9eb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:54.493060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6d1cc-fee1-4e74-98c4-bbff459e9eb9 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:54.501441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1234/2451] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:17:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:17:57.996595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2231b-c6b7-4c08-af4c-c4d6e662fa82 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:57.998001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0fd2231b-c6b7-4c08-af4c-c4d6e662fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:58.009885 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2231b-c6b7-4c08-af4c-c4d6e662fa82 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:58.013482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eea40d-7c1b-4508-8f61-383ad55da67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:58.014122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea40d-7c1b-4508-8f61-383ad55da67c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:58.014407 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea40d-7c1b-4508-8f61-383ad55da67c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:58.014684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea40d-7c1b-4508-8f61-383ad55da67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:58.016456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-08eea40d-7c1b-4508-8f61-383ad55da67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:58.094414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eea40d-7c1b-4508-8f61-383ad55da67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:58.096413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eea40d-7c1b-4508-8f61-383ad55da67c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:58.110982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1218/2452] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:59.573989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6d1cc-fee1-4e74-98c4-bbff459e9eb9 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:59.585562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6d1cc-fee1-4e74-98c4-bbff459e9eb9 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:59.589388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7955cb7-5308-4c0d-a9db-bf44c6019c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:59.590026 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955cb7-5308-4c0d-a9db-bf44c6019c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:59.590306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955cb7-5308-4c0d-a9db-bf44c6019c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:59.590580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955cb7-5308-4c0d-a9db-bf44c6019c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:59.592383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c7955cb7-5308-4c0d-a9db-bf44c6019c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:59.607242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7955cb7-5308-4c0d-a9db-bf44c6019c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:59.608862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7955cb7-5308-4c0d-a9db-bf44c6019c68 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:59.625807 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1235/2453] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:18:08.103738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=59 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:09.615600 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=38 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:11.250105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eea40d-7c1b-4508-8f61-383ad55da67c service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:11.259626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eea40d-7c1b-4508-8f61-383ad55da67c service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:11.263466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0038d-5fd0-48ee-897e-f9aa5e704a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:11.264145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0038d-5fd0-48ee-897e-f9aa5e704a3f service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:11.264429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0038d-5fd0-48ee-897e-f9aa5e704a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:11.264703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0038d-5fd0-48ee-897e-f9aa5e704a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:11.266611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-93b0038d-5fd0-48ee-897e-f9aa5e704a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:11.277375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0038d-5fd0-48ee-897e-f9aa5e704a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:11.278792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0038d-5fd0-48ee-897e-f9aa5e704a3f service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:11.287711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1219/2454] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:11.609109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a87d5d-ff91-4383-93ff-09d6c7cf89c5 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:11.609597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a87d5d-ff91-4383-93ff-09d6c7cf89c5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:11.609762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a87d5d-ff91-4383-93ff-09d6c7cf89c5 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:11.611388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1236/2455] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:18:11.617557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168acbab-d132-46a9-9d80-79272bb595ad None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:11.617842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168acbab-d132-46a9-9d80-79272bb595ad None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:11.618119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168acbab-d132-46a9-9d80-79272bb595ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:11.656923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-168acbab-d132-46a9-9d80-79272bb595ad None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:11.658234 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-168acbab-d132-46a9-9d80-79272bb595ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:11.667747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1220/2456] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:18:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:11.679374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a87d5d-ff91-4383-93ff-09d6c7cf89c5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:11.680998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-85a87d5d-ff91-4383-93ff-09d6c7cf89c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:11.732894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168acbab-d132-46a9-9d80-79272bb595ad None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:11.734647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-168acbab-d132-46a9-9d80-79272bb595ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:11.748707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168acbab-d132-46a9-9d80-79272bb595ad None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:11.754636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f04c9a-c572-4199-bfa0-7a2b85c05e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:11.755303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f04c9a-c572-4199-bfa0-7a2b85c05e79 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:11.755587 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f04c9a-c572-4199-bfa0-7a2b85c05e79 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:11.755862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f04c9a-c572-4199-bfa0-7a2b85c05e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:11.757604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-52f04c9a-c572-4199-bfa0-7a2b85c05e79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:11.758675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a87d5d-ff91-4383-93ff-09d6c7cf89c5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:11.762172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e0f73-dff9-42c2-bbce-e0eb87aebe2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbc657ed3ae49dc9d45687c5dde2ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:11.762810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e0f73-dff9-42c2-bbce-e0eb87aebe2f service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:11.763089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e0f73-dff9-42c2-bbce-e0eb87aebe2f service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:11.763389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e0f73-dff9-42c2-bbce-e0eb87aebe2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:11.774229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e0f73-dff9-42c2-bbce-e0eb87aebe2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:11.775671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e0f73-dff9-42c2-bbce-e0eb87aebe2f service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:11.786292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1237/2457] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:11.820207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f04c9a-c572-4199-bfa0-7a2b85c05e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:11.822005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f04c9a-c572-4199-bfa0-7a2b85c05e79 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:11.831548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1221/2458] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:18:12.006042 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbaa64-9e5c-4e1e-875a-b22f194a4203 None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.006283 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbaa64-9e5c-4e1e-875a-b22f194a4203 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.006555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbaa64-9e5c-4e1e-875a-b22f194a4203 None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.007948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1238/2459] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:18:12.012758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11beab-9074-42c9-805b-dd22dd77b595 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.013049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11beab-9074-42c9-805b-dd22dd77b595 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.013405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11beab-9074-42c9-805b-dd22dd77b595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.051127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0e11beab-9074-42c9-805b-dd22dd77b595 None None] MFA Rules not processed for user `4bc0ef455caa4ee5b6b86dc1904d4e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:12.052346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e11beab-9074-42c9-805b-dd22dd77b595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.058942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1222/2460] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:18:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:12.071392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbaa64-9e5c-4e1e-875a-b22f194a4203 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:12.082191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbaa64-9e5c-4e1e-875a-b22f194a4203 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:12.085698 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393ccf6-4e07-42c6-97af-b1a5999d9810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:12.086324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393ccf6-4e07-42c6-97af-b1a5999d9810 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.086628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393ccf6-4e07-42c6-97af-b1a5999d9810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.086896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393ccf6-4e07-42c6-97af-b1a5999d9810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.095042 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393ccf6-4e07-42c6-97af-b1a5999d9810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:12.095913 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393ccf6-4e07-42c6-97af-b1a5999d9810 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:12.104085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1239/2461] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:12.187326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7479d-bbe0-4b84-aebd-2713a48fc288 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.187619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7479d-bbe0-4b84-aebd-2713a48fc288 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.187927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7479d-bbe0-4b84-aebd-2713a48fc288 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.189920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1223/2462] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:18:12.195060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6a2c-101f-45ec-a3de-e795c40e1fd0 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.195390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6a2c-101f-45ec-a3de-e795c40e1fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.195664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6a2c-101f-45ec-a3de-e795c40e1fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.214179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-738e6a2c-101f-45ec-a3de-e795c40e1fd0 None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:12.215407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-738e6a2c-101f-45ec-a3de-e795c40e1fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.226598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1240/2463] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:18:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:12.237741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7479d-bbe0-4b84-aebd-2713a48fc288 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:12.249124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7479d-bbe0-4b84-aebd-2713a48fc288 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:12.252856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9f870-bb0a-4636-bdaf-6d97b276d1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:12.253489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9f870-bb0a-4636-bdaf-6d97b276d1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.253773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9f870-bb0a-4636-bdaf-6d97b276d1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.254052 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9f870-bb0a-4636-bdaf-6d97b276d1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.267855 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9f870-bb0a-4636-bdaf-6d97b276d1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:12.267855 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9f870-bb0a-4636-bdaf-6d97b276d1a4 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:12.277520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1224/2464] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:12.345855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6a2c-101f-45ec-a3de-e795c40e1fd0 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:12.347288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-738e6a2c-101f-45ec-a3de-e795c40e1fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.415573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6a2c-101f-45ec-a3de-e795c40e1fd0 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:12.420784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcb33d-a4cb-426f-9c39-2172915598b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:12.421434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb33d-a4cb-426f-9c39-2172915598b7 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.421755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb33d-a4cb-426f-9c39-2172915598b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.422029 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb33d-a4cb-426f-9c39-2172915598b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.424505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cabcb33d-a4cb-426f-9c39-2172915598b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.435865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcb33d-a4cb-426f-9c39-2172915598b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:12.437433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcb33d-a4cb-426f-9c39-2172915598b7 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:12.447152 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1241/2465] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:21.598803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9f870-bb0a-4636-bdaf-6d97b276d1a4 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:21.607696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9f870-bb0a-4636-bdaf-6d97b276d1a4 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:21.611907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb6b6-d3d8-4956-9db1-32a020b15ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:21.612545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb6b6-d3d8-4956-9db1-32a020b15ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:21.612828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb6b6-d3d8-4956-9db1-32a020b15ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:21.613123 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb6b6-d3d8-4956-9db1-32a020b15ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:21.615253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1dafb6b6-d3d8-4956-9db1-32a020b15ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:21.625092 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafb6b6-d3d8-4956-9db1-32a020b15ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:21.627089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafb6b6-d3d8-4956-9db1-32a020b15ac4 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:21.635070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1225/2466] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:18:22.443061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=76 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:23.198144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679769c8-2e6d-4075-b444-6c2b54c3237e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:23.198430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679769c8-2e6d-4075-b444-6c2b54c3237e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:23.198702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679769c8-2e6d-4075-b444-6c2b54c3237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:23.215998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-679769c8-2e6d-4075-b444-6c2b54c3237e None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:23.217173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-679769c8-2e6d-4075-b444-6c2b54c3237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:23.224164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1242/2467] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:18:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:23.236341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb6b6-d3d8-4956-9db1-32a020b15ac4 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:23.248327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb6b6-d3d8-4956-9db1-32a020b15ac4 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:23.253903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0aa984-323c-45e5-a740-8fedb9e1df52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:23.254542 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa984-323c-45e5-a740-8fedb9e1df52 service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:23.254823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa984-323c-45e5-a740-8fedb9e1df52 service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:23.255122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa984-323c-45e5-a740-8fedb9e1df52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:23.263846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0aa984-323c-45e5-a740-8fedb9e1df52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:23.265468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0aa984-323c-45e5-a740-8fedb9e1df52 service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:23.273874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1226/2468] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:18:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:18:33.210777 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:33.270616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=70 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:46.421281 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ed01-e8a1-4155-8a0c-4c843fa1ce2e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:46.421818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ed01-e8a1-4155-8a0c-4c843fa1ce2e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:46.421915 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495ed01-e8a1-4155-8a0c-4c843fa1ce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:46.440219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4495ed01-e8a1-4155-8a0c-4c843fa1ce2e None None] MFA Rules not processed for user `a696d00855ef439c9d80b6bec5312f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:46.441418 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4495ed01-e8a1-4155-8a0c-4c843fa1ce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:46.448208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1243/2469] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:50.144417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0aa984-323c-45e5-a740-8fedb9e1df52 service swift] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:50.156581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0aa984-323c-45e5-a740-8fedb9e1df52 service swift] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:50.162245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9016f3b-a30b-4fe3-aafd-8abe329c5845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:50.162900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016f3b-a30b-4fe3-aafd-8abe329c5845 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.163199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016f3b-a30b-4fe3-aafd-8abe329c5845 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.163476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9016f3b-a30b-4fe3-aafd-8abe329c5845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.165270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c9016f3b-a30b-4fe3-aafd-8abe329c5845 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:50.178127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9016f3b-a30b-4fe3-aafd-8abe329c5845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:50.179727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9016f3b-a30b-4fe3-aafd-8abe329c5845 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:50.190693 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1227/2470] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:53.885001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495ed01-e8a1-4155-8a0c-4c843fa1ce2e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:53.899395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495ed01-e8a1-4155-8a0c-4c843fa1ce2e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:53.905076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22723445-0d83-4fc7-802f-14e0d7e10ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:53.905774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22723445-0d83-4fc7-802f-14e0d7e10ee2 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:53.906055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22723445-0d83-4fc7-802f-14e0d7e10ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:53.906473 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22723445-0d83-4fc7-802f-14e0d7e10ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:53.908655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-22723445-0d83-4fc7-802f-14e0d7e10ee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:53.921238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22723445-0d83-4fc7-802f-14e0d7e10ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:53.925034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22723445-0d83-4fc7-802f-14e0d7e10ee2 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:53.934642 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1244/2471] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:54.438058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c43e0-4405-4d94-80bb-4571e56df057 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:54.438554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c43e0-4405-4d94-80bb-4571e56df057 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:54.438639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c43e0-4405-4d94-80bb-4571e56df057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:54.458438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8a1c43e0-4405-4d94-80bb-4571e56df057 None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:54.459769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a1c43e0-4405-4d94-80bb-4571e56df057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:54.467284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1228/2472] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 2 10:18:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:54.480913 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22723445-0d83-4fc7-802f-14e0d7e10ee2 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:54.492010 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22723445-0d83-4fc7-802f-14e0d7e10ee2 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:54.496793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667cc7f-d469-4137-b8fc-83d87f1e4523 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:54.497427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667cc7f-d469-4137-b8fc-83d87f1e4523 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:54.497702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667cc7f-d469-4137-b8fc-83d87f1e4523 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:54.497970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667cc7f-d469-4137-b8fc-83d87f1e4523 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:54.506634 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667cc7f-d469-4137-b8fc-83d87f1e4523 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:54.508213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667cc7f-d469-4137-b8fc-83d87f1e4523 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:54.517195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1245/2473] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:18:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 10:19:04.452713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=9 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:04.513485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=15 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:17.565288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c43e0-4405-4d94-80bb-4571e56df057 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:17.566687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8a1c43e0-4405-4d94-80bb-4571e56df057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:17.582717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c43e0-4405-4d94-80bb-4571e56df057 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:17.588191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dbb09-4018-4180-ae87-4fdd8819b8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:17.588847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dbb09-4018-4180-ae87-4fdd8819b8b0 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:17.589131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dbb09-4018-4180-ae87-4fdd8819b8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:17.589408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dbb09-4018-4180-ae87-4fdd8819b8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:17.591130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-aa1dbb09-4018-4180-ae87-4fdd8819b8b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:17.601496 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1dbb09-4018-4180-ae87-4fdd8819b8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:17.603118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1dbb09-4018-4180-ae87-4fdd8819b8b0 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:17.612237 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1229/2474] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:21.283355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667cc7f-d469-4137-b8fc-83d87f1e4523 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:21.303627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667cc7f-d469-4137-b8fc-83d87f1e4523 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:21.311789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76a87d-56a2-4444-883a-c3f809cca1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:21.316502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76a87d-56a2-4444-883a-c3f809cca1d6 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:21.316888 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76a87d-56a2-4444-883a-c3f809cca1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:21.317188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76a87d-56a2-4444-883a-c3f809cca1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:21.320596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8f76a87d-56a2-4444-883a-c3f809cca1d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:21.365571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76a87d-56a2-4444-883a-c3f809cca1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:21.368945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76a87d-56a2-4444-883a-c3f809cca1d6 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:21.396195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1246/2475] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:27.608046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:31.386934 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:32.417931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bd82-a8f4-42af-ab6e-78fd0577ee23 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:32.418385 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bd82-a8f4-42af-ab6e-78fd0577ee23 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:32.418484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bd82-a8f4-42af-ab6e-78fd0577ee23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:32.435707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3003bd82-a8f4-42af-ab6e-78fd0577ee23 None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:32.437316 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3003bd82-a8f4-42af-ab6e-78fd0577ee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:32.444339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1230/2476] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 2 10:19:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:32.465926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76a87d-56a2-4444-883a-c3f809cca1d6 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:32.477072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76a87d-56a2-4444-883a-c3f809cca1d6 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:32.482049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805273e3-d22f-48ef-8cf0-2c2905621a47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:32.482704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805273e3-d22f-48ef-8cf0-2c2905621a47 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:32.482991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805273e3-d22f-48ef-8cf0-2c2905621a47 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:32.483300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805273e3-d22f-48ef-8cf0-2c2905621a47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:32.491582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805273e3-d22f-48ef-8cf0-2c2905621a47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:32.493149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805273e3-d22f-48ef-8cf0-2c2905621a47 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:32.501763 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1247/2477] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:19:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:19:35.677654 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e4d37-2a80-458b-bed7-83e677112299 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:35.678140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e4d37-2a80-458b-bed7-83e677112299 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:35.678354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e4d37-2a80-458b-bed7-83e677112299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:35.697489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3f4e4d37-2a80-458b-bed7-83e677112299 None None] MFA Rules not processed for user `0514d3b22d94435196f8bf1eff26699e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:35.699119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3f4e4d37-2a80-458b-bed7-83e677112299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:35.708725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1231/2478] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:37.207794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805273e3-d22f-48ef-8cf0-2c2905621a47 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:37.207794 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-805273e3-d22f-48ef-8cf0-2c2905621a47 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:37.222143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805273e3-d22f-48ef-8cf0-2c2905621a47 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:37.227531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:37.230769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:37.230769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:37.230769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:37.230769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:37.243365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:37.244958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:37.256452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1248/2479] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:41.812483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e4d37-2a80-458b-bed7-83e677112299 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:41.824554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e4d37-2a80-458b-bed7-83e677112299 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:41.829604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3ae60-c6d6-4c8e-ad09-b37cd39cdc27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:41.830241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3ae60-c6d6-4c8e-ad09-b37cd39cdc27 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:41.830518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3ae60-c6d6-4c8e-ad09-b37cd39cdc27 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:41.830787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3ae60-c6d6-4c8e-ad09-b37cd39cdc27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:41.832551 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-90d3ae60-c6d6-4c8e-ad09-b37cd39cdc27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:41.844194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3ae60-c6d6-4c8e-ad09-b37cd39cdc27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:41.845811 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3ae60-c6d6-4c8e-ad09-b37cd39cdc27 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:41.855799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1232/2480] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:41.944535 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:41.945970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:42.010093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf847e1-3d11-4133-873e-f638dc78ed7d service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:42.014547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:42.015446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:42.015729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:42.020497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] PATH_INFO: `/v3/users/f4a690835f9143b096f00fceb47d4a10` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:42.020497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a690835f9143b096f00fceb47d4a10)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:42.020497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:42.207230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a690835f9143b096f00fceb47d4a10'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.207878 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a690835f9143b096f00fceb47d4a10'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.208505 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a690835f9143b096f00fceb47d4a10'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.220966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a690835f9143b096f00fceb47d4a10'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.227857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a690835f9143b096f00fceb47d4a10'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.320996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1249/2481] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:41 2022] DELETE /identity/v3/users/f4a690835f9143b096f00fceb47d4a10 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:42.642584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3ae60-c6d6-4c8e-ad09-b37cd39cdc27 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:42.653378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3ae60-c6d6-4c8e-ad09-b37cd39cdc27 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:42.713623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:42.714507 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:42.714792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:42.715064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] PATH_INFO: `/v3/projects/0fe7771afa3e4fb0a3fcfa8f328c1ebb` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:42.716280 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe7771afa3e4fb0a3fcfa8f328c1ebb)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:42.718775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:42.882443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'request_id': 'req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.888504 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'request_id': 'req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.966561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'request_id': 'req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.977573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] The token cache is being invalidate because project 0fe7771afa3e4fb0a3fcfa8f328c1ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:42.977857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.978476 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:42.980081 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1233/2482] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:42 2022] DELETE /identity/v3/projects/0fe7771afa3e4fb0a3fcfa8f328c1ebb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:42.983994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:42.985383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:42.998561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71409a4f-e560-48d0-8f02-a4fc8582ff36 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:43.045954 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:43.054583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:43.055479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:43.057939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:43.057939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] PATH_INFO: `/v3/users/405ba2af54df40b48138f488235bea9f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:43.057939 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=405ba2af54df40b48138f488235bea9f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:43.059070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:43.262291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405ba2af54df40b48138f488235bea9f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.262956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405ba2af54df40b48138f488235bea9f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.263661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405ba2af54df40b48138f488235bea9f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.276855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405ba2af54df40b48138f488235bea9f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.284007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405ba2af54df40b48138f488235bea9f'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.355744 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1250/2483] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:42 2022] DELETE /identity/v3/users/405ba2af54df40b48138f488235bea9f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:43.624471 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:43.625874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:43.648661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bcf62-4de3-4e5d-b48a-bc50d757c0ec admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:43.708822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:43.709885 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:43.710114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:43.710396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] PATH_INFO: `/v3/projects/872bc6a2f90541c88ecd90da7b56d568` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:43.711611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=872bc6a2f90541c88ecd90da7b56d568)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:43.713510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:43.720645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:43.817384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872bc6a2f90541c88ecd90da7b56d568', 'request_id': 'req-863c66f7-f221-4bdb-ae18-bc81b6894c81'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.823671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872bc6a2f90541c88ecd90da7b56d568', 'request_id': 'req-863c66f7-f221-4bdb-ae18-bc81b6894c81'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.892096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872bc6a2f90541c88ecd90da7b56d568', 'request_id': 'req-863c66f7-f221-4bdb-ae18-bc81b6894c81'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.902779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] The token cache is being invalidate because project 872bc6a2f90541c88ecd90da7b56d568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:43.903206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.904371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-863c66f7-f221-4bdb-ae18-bc81b6894c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.906488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1234/2484] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:43 2022] DELETE /identity/v3/projects/872bc6a2f90541c88ecd90da7b56d568 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:53.351412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:53.904536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:04.096395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.107008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:04.171910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711b56-0cca-436a-a8ef-afbb9b6cfd75 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.233316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.234543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.234828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.235123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.237211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:04.299938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.304759 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.311153 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1251/2485] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:13.705039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4869-1b81-4d2a-98d2-15a170d422f7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.706077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4869-1b81-4d2a-98d2-15a170d422f7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.706369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4869-1b81-4d2a-98d2-15a170d422f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.725621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-873b4869-1b81-4d2a-98d2-15a170d422f7 None None] MFA Rules not processed for user `722fc8b42ea941499a56937ce0d8ad3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:13.726905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-873b4869-1b81-4d2a-98d2-15a170d422f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:13.794392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1235/2486] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:14.150074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:14.151705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:14.192498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:14.212799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03f996-1b41-47b0-a5b8-2f83e7f3080a service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:14.216685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:14.217884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:14.218654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:14.219280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:14.221131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:14.232566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:14.236512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:14.260661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1252/2487] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:19.445115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e236e-2872-4483-8089-90cfffecf511 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.445635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e236e-2872-4483-8089-90cfffecf511 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.445744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e236e-2872-4483-8089-90cfffecf511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.482887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c02e236e-2872-4483-8089-90cfffecf511 None None] MFA Rules not processed for user `5a6e44ab0c394541a7d7b290928ea6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:19.483972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c02e236e-2872-4483-8089-90cfffecf511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:19.499187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1236/2488] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:24.254072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=10 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:25.691821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:25.693426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:25.703812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce142f-9131-4fc6-a3be-b76fa942f91a service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:25.707945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8a17f-56fe-4b48-9e47-0a8cef912fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:25.708584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8a17f-56fe-4b48-9e47-0a8cef912fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:25.708865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8a17f-56fe-4b48-9e47-0a8cef912fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:25.709136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8a17f-56fe-4b48-9e47-0a8cef912fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:25.710977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-64c8a17f-56fe-4b48-9e47-0a8cef912fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:25.776502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8a17f-56fe-4b48-9e47-0a8cef912fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:25.778075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8a17f-56fe-4b48-9e47-0a8cef912fc7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:25.787730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1253/2489] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:29.465489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=28 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:29.841814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e236e-2872-4483-8089-90cfffecf511 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:29.843762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c02e236e-2872-4483-8089-90cfffecf511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:29.862094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e236e-2872-4483-8089-90cfffecf511 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:29.866901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:29.867893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:29.868181 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:29.868459 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] PATH_INFO: `/v3/users/a696d00855ef439c9d80b6bec5312f20` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:29.869660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a696d00855ef439c9d80b6bec5312f20)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:29.871717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.036921 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a696d00855ef439c9d80b6bec5312f20'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.037577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a696d00855ef439c9d80b6bec5312f20'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.050378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a696d00855ef439c9d80b6bec5312f20'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.057403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a696d00855ef439c9d80b6bec5312f20'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.058269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4a2ac2f4-aa8a-49a4-ac1c-55001ce3f7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a696d00855ef439c9d80b6bec5312f20'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.114910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1237/2490] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:29 2022] DELETE /identity/v3/users/a696d00855ef439c9d80b6bec5312f20 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:30.360987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8a17f-56fe-4b48-9e47-0a8cef912fc7 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.373133 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8a17f-56fe-4b48-9e47-0a8cef912fc7 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.447707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.448569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.448848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.449119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] PATH_INFO: `/v3/projects/86951ec86e2046c3bbba0ba1bc6738e2` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.450312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86951ec86e2046c3bbba0ba1bc6738e2)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.452241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.538155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86951ec86e2046c3bbba0ba1bc6738e2', 'request_id': 'req-00b50c59-b963-478d-98fd-492a0d568762'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.544587 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86951ec86e2046c3bbba0ba1bc6738e2', 'request_id': 'req-00b50c59-b963-478d-98fd-492a0d568762'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.588061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86951ec86e2046c3bbba0ba1bc6738e2', 'request_id': 'req-00b50c59-b963-478d-98fd-492a0d568762'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.601068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] The token cache is being invalidate because project 86951ec86e2046c3bbba0ba1bc6738e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:30.601660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.602514 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-00b50c59-b963-478d-98fd-492a0d568762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.604396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1254/2491] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:30 2022] DELETE /identity/v3/projects/86951ec86e2046c3bbba0ba1bc6738e2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:30.609262 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83157bd-97a9-4c75-b311-719d9f9a313c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.609725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83157bd-97a9-4c75-b311-719d9f9a313c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.609899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83157bd-97a9-4c75-b311-719d9f9a313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.629286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d83157bd-97a9-4c75-b311-719d9f9a313c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:30.630573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d83157bd-97a9-4c75-b311-719d9f9a313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:30.694278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1238/2492] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:30.702431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815d7f-ccff-4646-90d9-7d6b9e12002d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.702719 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815d7f-ccff-4646-90d9-7d6b9e12002d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.703451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815d7f-ccff-4646-90d9-7d6b9e12002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.724047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cf815d7f-ccff-4646-90d9-7d6b9e12002d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:30.724870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cf815d7f-ccff-4646-90d9-7d6b9e12002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:30.732550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1255/2493] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:30.736965 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83157bd-97a9-4c75-b311-719d9f9a313c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.746370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83157bd-97a9-4c75-b311-719d9f9a313c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.750818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aa493-a20a-49d0-a150-b124467a8519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.751504 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aa493-a20a-49d0-a150-b124467a8519 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.751783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aa493-a20a-49d0-a150-b124467a8519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.752048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aa493-a20a-49d0-a150-b124467a8519 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.752762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aa493-a20a-49d0-a150-b124467a8519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:20:30.753065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aa493-a20a-49d0-a150-b124467a8519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.754781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aa493-a20a-49d0-a150-b124467a8519 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.766883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1239/2494] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:20:30.771681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815d7f-ccff-4646-90d9-7d6b9e12002d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.781102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815d7f-ccff-4646-90d9-7d6b9e12002d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.786727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9813cf-6530-4d2a-9fed-a3015782b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.787500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9813cf-6530-4d2a-9fed-a3015782b1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.787786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9813cf-6530-4d2a-9fed-a3015782b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.788147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9813cf-6530-4d2a-9fed-a3015782b1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.788869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9813cf-6530-4d2a-9fed-a3015782b1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.790787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9813cf-6530-4d2a-9fed-a3015782b1a9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.805874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:30.900482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1256/2495] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:30 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:30.905333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aa493-a20a-49d0-a150-b124467a8519 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.915828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aa493-a20a-49d0-a150-b124467a8519 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.984487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890c6c-8861-4898-9f68-fa902aad6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.984816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890c6c-8861-4898-9f68-fa902aad6259 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.985100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890c6c-8861-4898-9f68-fa902aad6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.985379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890c6c-8861-4898-9f68-fa902aad6259 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.986082 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42890c6c-8861-4898-9f68-fa902aad6259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.997700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42890c6c-8861-4898-9f68-fa902aad6259 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:31.005514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:31.105058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1240/2496] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:30 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:31.109315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9813cf-6530-4d2a-9fed-a3015782b1a9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:31.134682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9813cf-6530-4d2a-9fed-a3015782b1a9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:31.140682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b08be6-9e2f-4fac-80ff-beffc00a63ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:31.142059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b08be6-9e2f-4fac-80ff-beffc00a63ba admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:31.142345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b08be6-9e2f-4fac-80ff-beffc00a63ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:31.142614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b08be6-9e2f-4fac-80ff-beffc00a63ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:31.143399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b08be6-9e2f-4fac-80ff-beffc00a63ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:31.145055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b08be6-9e2f-4fac-80ff-beffc00a63ba admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:31.157853 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1257/2497] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:31.161987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890c6c-8861-4898-9f68-fa902aad6259 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:31.173766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890c6c-8861-4898-9f68-fa902aad6259 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:31.180458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3d0a-6030-4c27-98f9-7e9fff8dbbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:31.180458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3d0a-6030-4c27-98f9-7e9fff8dbbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:31.180458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3d0a-6030-4c27-98f9-7e9fff8dbbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:31.181849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3d0a-6030-4c27-98f9-7e9fff8dbbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:31.181849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3d0a-6030-4c27-98f9-7e9fff8dbbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:31.183643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3d0a-6030-4c27-98f9-7e9fff8dbbb4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:31.197040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1241/2498] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:31.201383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b08be6-9e2f-4fac-80ff-beffc00a63ba admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:31.215776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b08be6-9e2f-4fac-80ff-beffc00a63ba admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:31.224013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b074fd-160f-4aeb-8857-335ff0a8b001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:31.225592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b074fd-160f-4aeb-8857-335ff0a8b001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:31.226088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b074fd-160f-4aeb-8857-335ff0a8b001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:31.226399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b074fd-160f-4aeb-8857-335ff0a8b001 admin admin] PATH_INFO: `/v3/projects/2083731013634acc8fcf98adceb19061/users/3a59ab67afb940fe96373251e2e80cf6/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:31.248866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b074fd-160f-4aeb-8857-335ff0a8b001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2083731013634acc8fcf98adceb19061, user_id=3a59ab67afb940fe96373251e2e80cf6, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:31.273559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b074fd-160f-4aeb-8857-335ff0a8b001 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:31.405871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1258/2499] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:31 2022] PUT /identity/v3/projects/2083731013634acc8fcf98adceb19061/users/3a59ab67afb940fe96373251e2e80cf6/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:31.411386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924149bd-217c-426a-93e3-839ac14b70ac None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:31.411807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924149bd-217c-426a-93e3-839ac14b70ac None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:31.412183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924149bd-217c-426a-93e3-839ac14b70ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:31.433295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-924149bd-217c-426a-93e3-839ac14b70ac None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:31.434613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-924149bd-217c-426a-93e3-839ac14b70ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:31.511064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1242/2500] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:31.539412 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b074fd-160f-4aeb-8857-335ff0a8b001 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:31.541812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-92b074fd-160f-4aeb-8857-335ff0a8b001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:31.619997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b074fd-160f-4aeb-8857-335ff0a8b001 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:31.623929 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af464-5e43-4f81-8bb9-7b563d63cc61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:31.624583 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af464-5e43-4f81-8bb9-7b563d63cc61 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:31.624992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af464-5e43-4f81-8bb9-7b563d63cc61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:31.625182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af464-5e43-4f81-8bb9-7b563d63cc61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:31.636030 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af464-5e43-4f81-8bb9-7b563d63cc61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:31.640315 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af464-5e43-4f81-8bb9-7b563d63cc61 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:31.648270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1259/2501] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:20:38.956355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfd517-2ead-4e0d-a440-d1a5430ab0ba None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:38.956756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfd517-2ead-4e0d-a440-d1a5430ab0ba None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:38.956902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfd517-2ead-4e0d-a440-d1a5430ab0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:38.986617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d7cfd517-2ead-4e0d-a440-d1a5430ab0ba None None] MFA Rules not processed for user `3a59ab67afb940fe96373251e2e80cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:38.988585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d7cfd517-2ead-4e0d-a440-d1a5430ab0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:39.063759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1243/2502] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:39.078669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af464-5e43-4f81-8bb9-7b563d63cc61 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:39.080147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ad9af464-5e43-4f81-8bb9-7b563d63cc61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:39.181646 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af464-5e43-4f81-8bb9-7b563d63cc61 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:39.187838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10da33-6719-48d0-8b2b-7bcfe1857e46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:39.188990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10da33-6719-48d0-8b2b-7bcfe1857e46 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:39.189492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10da33-6719-48d0-8b2b-7bcfe1857e46 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:39.190012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10da33-6719-48d0-8b2b-7bcfe1857e46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:39.202591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10da33-6719-48d0-8b2b-7bcfe1857e46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:39.204478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10da33-6719-48d0-8b2b-7bcfe1857e46 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:39.225199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1260/2503] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:42.794674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3b350-ba81-4187-aeb0-7970677832cc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:42.803467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3b350-ba81-4187-aeb0-7970677832cc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:42.803467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3b350-ba81-4187-aeb0-7970677832cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:42.814834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4fb3b350-ba81-4187-aeb0-7970677832cc None None] MFA Rules not processed for user `3a59ab67afb940fe96373251e2e80cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:42.816078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4fb3b350-ba81-4187-aeb0-7970677832cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:42.822902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1244/2504] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:20:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:49.223973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:52.808453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:22.883995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10da33-6719-48d0-8b2b-7bcfe1857e46 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:22.885549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2e10da33-6719-48d0-8b2b-7bcfe1857e46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:22.955971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10da33-6719-48d0-8b2b-7bcfe1857e46 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:22.961597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d4d09-c917-4c47-9813-b534fc1c2a15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:22.962240 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d4d09-c917-4c47-9813-b534fc1c2a15 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:22.962523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d4d09-c917-4c47-9813-b534fc1c2a15 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:22.962799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d4d09-c917-4c47-9813-b534fc1c2a15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:22.964645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f10d4d09-c917-4c47-9813-b534fc1c2a15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:22.977382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d4d09-c917-4c47-9813-b534fc1c2a15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:22.978966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d4d09-c917-4c47-9813-b534fc1c2a15 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:22.989195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1261/2505] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:21:27.287220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371aa05-a991-4cff-bd1d-236cfaa44447 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:27.287220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371aa05-a991-4cff-bd1d-236cfaa44447 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:27.287220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371aa05-a991-4cff-bd1d-236cfaa44447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:27.304692 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6371aa05-a991-4cff-bd1d-236cfaa44447 None None] MFA Rules not processed for user `0514d3b22d94435196f8bf1eff26699e`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:27.305916 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6371aa05-a991-4cff-bd1d-236cfaa44447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:27.360498 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1245/2506] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:21:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:32.985020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=32 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:37.353745 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=25 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:25.536607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1e263-a92d-4264-a31b-94a9de35358e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:25.537132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1e263-a92d-4264-a31b-94a9de35358e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:25.537239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1e263-a92d-4264-a31b-94a9de35358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:25.554465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fde1e263-a92d-4264-a31b-94a9de35358e None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:22:25.555692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fde1e263-a92d-4264-a31b-94a9de35358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:25.610302 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1262/2507] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:22:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:22:25.737585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371aa05-a991-4cff-bd1d-236cfaa44447 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:25.739060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6371aa05-a991-4cff-bd1d-236cfaa44447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:25.807877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371aa05-a991-4cff-bd1d-236cfaa44447 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:25.813468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91974b4-2b49-4195-8be6-59a09453dfbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:25.814113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91974b4-2b49-4195-8be6-59a09453dfbf service swift] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:25.814398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91974b4-2b49-4195-8be6-59a09453dfbf service swift] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:25.815306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91974b4-2b49-4195-8be6-59a09453dfbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:25.823457 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91974b4-2b49-4195-8be6-59a09453dfbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:25.825044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91974b4-2b49-4195-8be6-59a09453dfbf service swift] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:25.833105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1246/2508] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:22:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:22:35.603522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=25 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:35.830391 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=32 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:42.066757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1e263-a92d-4264-a31b-94a9de35358e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:42.068187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fde1e263-a92d-4264-a31b-94a9de35358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:42.124075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1e263-a92d-4264-a31b-94a9de35358e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:42.127625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f28bb7-ba3c-486d-bb3e-e770951b51b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:42.128274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f28bb7-ba3c-486d-bb3e-e770951b51b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:42.128550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f28bb7-ba3c-486d-bb3e-e770951b51b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:42.128819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f28bb7-ba3c-486d-bb3e-e770951b51b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:42.130672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f2f28bb7-ba3c-486d-bb3e-e770951b51b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:42.189320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f28bb7-ba3c-486d-bb3e-e770951b51b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:42.190748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f28bb7-ba3c-486d-bb3e-e770951b51b7 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:42.200180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1263/2509] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:22:45.118364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b904f8-d8b5-431a-bc68-a705eb651fb5 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:45.118934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b904f8-d8b5-431a-bc68-a705eb651fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:45.118934 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b904f8-d8b5-431a-bc68-a705eb651fb5 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:45.120431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1247/2510] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:22:45.127703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366079c-9c86-477d-8676-7489b695c844 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:45.128735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366079c-9c86-477d-8676-7489b695c844 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:45.129375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366079c-9c86-477d-8676-7489b695c844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:45.147890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f366079c-9c86-477d-8676-7489b695c844 None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:22:45.149232 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f366079c-9c86-477d-8676-7489b695c844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:45.159585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1264/2511] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:22:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:22:45.176322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b904f8-d8b5-431a-bc68-a705eb651fb5 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:45.177545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-52b904f8-d8b5-431a-bc68-a705eb651fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:45.246416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b904f8-d8b5-431a-bc68-a705eb651fb5 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:45.250054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9462072-8a15-471c-a797-5fe9379abee8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbc657ed3ae49dc9d45687c5dde2ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:45.252867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9462072-8a15-471c-a797-5fe9379abee8 service glance] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:45.252867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9462072-8a15-471c-a797-5fe9379abee8 service glance] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:45.252867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9462072-8a15-471c-a797-5fe9379abee8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:45.261819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9462072-8a15-471c-a797-5fe9379abee8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:45.263284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9462072-8a15-471c-a797-5fe9379abee8 service glance] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:45.274847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1248/2512] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:22:45.444106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c332f38-85d3-4163-9bcd-8778a9ae86ec None None] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:45.444510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c332f38-85d3-4163-9bcd-8778a9ae86ec None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:45.444855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c332f38-85d3-4163-9bcd-8778a9ae86ec None None] PATH_INFO: `/` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:45.446321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1265/2513] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:22:45.451733 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029fb6-39fd-447c-9408-26298d759fcd None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:45.452022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029fb6-39fd-447c-9408-26298d759fcd None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:45.452300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029fb6-39fd-447c-9408-26298d759fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:45.473973 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-30029fb6-39fd-447c-9408-26298d759fcd None None] MFA Rules not processed for user `4bc0ef455caa4ee5b6b86dc1904d4e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:22:45.475272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-30029fb6-39fd-447c-9408-26298d759fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:45.482253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1249/2514] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:22:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:22:45.494679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c332f38-85d3-4163-9bcd-8778a9ae86ec None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:45.496523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4c332f38-85d3-4163-9bcd-8778a9ae86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:45.510289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c332f38-85d3-4163-9bcd-8778a9ae86ec None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:45.513856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb24694-d81a-4200-be7a-2c51abceb35f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:45.514506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb24694-d81a-4200-be7a-2c51abceb35f service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:45.514787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb24694-d81a-4200-be7a-2c51abceb35f service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:45.515062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb24694-d81a-4200-be7a-2c51abceb35f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:45.524075 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb24694-d81a-4200-be7a-2c51abceb35f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:45.525819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb24694-d81a-4200-be7a-2c51abceb35f service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:45.534926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1266/2515] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:22:45.619527 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730aaa6-ae71-443c-8d7c-6e092b711731 None None] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:45.619818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730aaa6-ae71-443c-8d7c-6e092b711731 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:45.620093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730aaa6-ae71-443c-8d7c-6e092b711731 None None] PATH_INFO: `/` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:45.621467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1250/2516] 10.222.0.13 () {54 vars in 921 bytes} [Thu Jun 2 10:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:22:45.626869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1239c-3a0b-4948-af73-5c9e3d5fc0f5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:45.627180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1239c-3a0b-4948-af73-5c9e3d5fc0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:45.627458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1239c-3a0b-4948-af73-5c9e3d5fc0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:45.646159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0eb1239c-3a0b-4948-af73-5c9e3d5fc0f5 None None] MFA Rules not processed for user `0b0591179ec144f5a90c9a24205b6b47`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:22:45.647382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0eb1239c-3a0b-4948-af73-5c9e3d5fc0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:45.656575 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1267/2517] 10.222.0.13 () {58 vars in 1018 bytes} [Thu Jun 2 10:22:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:22:45.666732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730aaa6-ae71-443c-8d7c-6e092b711731 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:45.677639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730aaa6-ae71-443c-8d7c-6e092b711731 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:45.681160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a46a8-5559-49cd-b017-05906f60d1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:45.681781 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a46a8-5559-49cd-b017-05906f60d1dc service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:45.682062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a46a8-5559-49cd-b017-05906f60d1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:45.682337 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a46a8-5559-49cd-b017-05906f60d1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:45.692823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a46a8-5559-49cd-b017-05906f60d1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:45.694237 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a46a8-5559-49cd-b017-05906f60d1dc service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:45.705360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1251/2518] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:22:47.250498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1239c-3a0b-4948-af73-5c9e3d5fc0f5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:47.260670 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1239c-3a0b-4948-af73-5c9e3d5fc0f5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:47.264560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5444acb-432c-4caf-92fc-3742c98e7de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:47.265211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5444acb-432c-4caf-92fc-3742c98e7de7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:47.265492 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5444acb-432c-4caf-92fc-3742c98e7de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:47.265767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5444acb-432c-4caf-92fc-3742c98e7de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:47.270582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c5444acb-432c-4caf-92fc-3742c98e7de7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:47.325792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5444acb-432c-4caf-92fc-3742c98e7de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:47.327865 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5444acb-432c-4caf-92fc-3742c98e7de7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:47.336824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1268/2519] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:22:48.388925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463dcae-78c1-4603-8c2f-c2a568047ea6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:48.393537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463dcae-78c1-4603-8c2f-c2a568047ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:48.393537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463dcae-78c1-4603-8c2f-c2a568047ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:48.408339 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f463dcae-78c1-4603-8c2f-c2a568047ea6 None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:22:48.409540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f463dcae-78c1-4603-8c2f-c2a568047ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:48.418902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1252/2520] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:22:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:22:48.430903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5444acb-432c-4caf-92fc-3742c98e7de7 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:48.442769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5444acb-432c-4caf-92fc-3742c98e7de7 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:48.447900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b4592-9d38-4aec-90ac-feb86ea8a93c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:48.451179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4592-9d38-4aec-90ac-feb86ea8a93c service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:48.451179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4592-9d38-4aec-90ac-feb86ea8a93c service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:48.451179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4592-9d38-4aec-90ac-feb86ea8a93c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:48.459823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b4592-9d38-4aec-90ac-feb86ea8a93c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:48.461749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b4592-9d38-4aec-90ac-feb86ea8a93c service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:48.471435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1269/2521] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:22:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:22:54.915350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b448300-e005-46f3-ae0a-ff75bbbb8851 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:54.915980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b448300-e005-46f3-ae0a-ff75bbbb8851 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:54.916140 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b448300-e005-46f3-ae0a-ff75bbbb8851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:54.934202 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-4b448300-e005-46f3-ae0a-ff75bbbb8851 None None] MFA Rules not processed for user `722fc8b42ea941499a56937ce0d8ad3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:22:54.935350 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4b448300-e005-46f3-ae0a-ff75bbbb8851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:54.943415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1253/2522] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:22:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:22:58.259285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b4592-9d38-4aec-90ac-feb86ea8a93c service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:58.272498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b4592-9d38-4aec-90ac-feb86ea8a93c service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:58.276612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e26e2-b657-4517-bb84-30827ceb685a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:58.277345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e26e2-b657-4517-bb84-30827ceb685a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:58.277866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e26e2-b657-4517-bb84-30827ceb685a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:58.278292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e26e2-b657-4517-bb84-30827ceb685a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:58.280456 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-698e26e2-b657-4517-bb84-30827ceb685a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:58.297884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e26e2-b657-4517-bb84-30827ceb685a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:58.299526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e26e2-b657-4517-bb84-30827ceb685a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:58.305757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:58.311580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1270/2523] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:22:59.508177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b448300-e005-46f3-ae0a-ff75bbbb8851 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:59.517820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b448300-e005-46f3-ae0a-ff75bbbb8851 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:59.521438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceb155-04b2-4f0f-adbe-29033beb6aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:59.522097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb155-04b2-4f0f-adbe-29033beb6aec service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:59.522383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb155-04b2-4f0f-adbe-29033beb6aec service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:59.522660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb155-04b2-4f0f-adbe-29033beb6aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:59.524477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-26ceb155-04b2-4f0f-adbe-29033beb6aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:59.538270 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceb155-04b2-4f0f-adbe-29033beb6aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:59.539738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ceb155-04b2-4f0f-adbe-29033beb6aec service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:59.550976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1254/2524] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:09.545667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=47 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:11.964732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e26e2-b657-4517-bb84-30827ceb685a service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:11.990512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e26e2-b657-4517-bb84-30827ceb685a service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:11.994251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856eb6e-d94d-4786-ae37-9468ad836827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:11.994918 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856eb6e-d94d-4786-ae37-9468ad836827 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:11.995210 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856eb6e-d94d-4786-ae37-9468ad836827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:11.995482 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856eb6e-d94d-4786-ae37-9468ad836827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:11.997317 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4856eb6e-d94d-4786-ae37-9468ad836827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:12.011849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856eb6e-d94d-4786-ae37-9468ad836827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:12.013290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856eb6e-d94d-4786-ae37-9468ad836827 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:12.023342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1271/2525] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:14.794685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e26f34-8c33-4c49-852a-97e90f69e807 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:14.795203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e26f34-8c33-4c49-852a-97e90f69e807 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:14.795305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e26f34-8c33-4c49-852a-97e90f69e807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:14.813252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e5e26f34-8c33-4c49-852a-97e90f69e807 None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:23:14.814443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e5e26f34-8c33-4c49-852a-97e90f69e807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:14.822149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1255/2526] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 2 10:23:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:23:14.838981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856eb6e-d94d-4786-ae37-9468ad836827 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:14.845772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856eb6e-d94d-4786-ae37-9468ad836827 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:14.851801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef546ba-aab3-4ee0-b4c3-e20b11e493e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:14.852443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef546ba-aab3-4ee0-b4c3-e20b11e493e5 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:14.852732 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef546ba-aab3-4ee0-b4c3-e20b11e493e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:14.853005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef546ba-aab3-4ee0-b4c3-e20b11e493e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:14.861577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef546ba-aab3-4ee0-b4c3-e20b11e493e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:14.863959 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef546ba-aab3-4ee0-b4c3-e20b11e493e5 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:14.872348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1272/2527] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:23:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 10:23:19.720732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e26f34-8c33-4c49-852a-97e90f69e807 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:19.722807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e5e26f34-8c33-4c49-852a-97e90f69e807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:19.736927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e26f34-8c33-4c49-852a-97e90f69e807 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:19.741400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:19.744828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:19.744828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:19.744828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] PATH_INFO: `/v3/users/929db9b6452f46ff9b854efb4a0d464a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:19.744828 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929db9b6452f46ff9b854efb4a0d464a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:19.745857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:19.907071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929db9b6452f46ff9b854efb4a0d464a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:19.907923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929db9b6452f46ff9b854efb4a0d464a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:19.921959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929db9b6452f46ff9b854efb4a0d464a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:19.929068 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929db9b6452f46ff9b854efb4a0d464a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:19.929776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929db9b6452f46ff9b854efb4a0d464a'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.024208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1256/2528] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:23:19 2022] DELETE /identity/v3/users/929db9b6452f46ff9b854efb4a0d464a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:20.265456 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef546ba-aab3-4ee0-b4c3-e20b11e493e5 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:20.276849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef546ba-aab3-4ee0-b4c3-e20b11e493e5 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:20.338425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:20.339339 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:20.339628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:20.339904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] PATH_INFO: `/v3/projects/520be3417a7047ef81cac4db926f3f20` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:20.341078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=520be3417a7047ef81cac4db926f3f20)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:20.343024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:20.453486 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520be3417a7047ef81cac4db926f3f20', 'request_id': 'req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.459578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520be3417a7047ef81cac4db926f3f20', 'request_id': 'req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.560710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520be3417a7047ef81cac4db926f3f20', 'request_id': 'req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.572259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] The token cache is being invalidate because project 520be3417a7047ef81cac4db926f3f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:23:20.576764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.576764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.576764 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1273/2529] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:23:20 2022] DELETE /identity/v3/projects/520be3417a7047ef81cac4db926f3f20 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:20.578840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:20.580431 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:20.593898 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51fb31-0099-4fd2-aaa6-82c0b57b4fb1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:20.664691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:20.666025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:20.666370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:20.666709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] PATH_INFO: `/v3/users/40335a26e6a247019043a2c3d18b492f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:20.668130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40335a26e6a247019043a2c3d18b492f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:20.670178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:20.854284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40335a26e6a247019043a2c3d18b492f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.854933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40335a26e6a247019043a2c3d18b492f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.867429 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40335a26e6a247019043a2c3d18b492f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.869402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:20.874706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40335a26e6a247019043a2c3d18b492f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.875382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40335a26e6a247019043a2c3d18b492f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:20.948726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1257/2530] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:23:20 2022] DELETE /identity/v3/users/40335a26e6a247019043a2c3d18b492f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:21.162531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:21.164151 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:21.178374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43cf06-61ca-4ca1-bfb1-4ce8ad85b5df admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:21.239585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:21.240439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:21.240712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:21.240977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] PATH_INFO: `/v3/projects/72ebda3c71fa4afdb922c731d602614d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:21.242137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ebda3c71fa4afdb922c731d602614d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:21.244047 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:21.250267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:21.339219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ebda3c71fa4afdb922c731d602614d', 'request_id': 'req-23e42899-e625-4982-973f-0238449bc014'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:21.345383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ebda3c71fa4afdb922c731d602614d', 'request_id': 'req-23e42899-e625-4982-973f-0238449bc014'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:21.423503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ebda3c71fa4afdb922c731d602614d', 'request_id': 'req-23e42899-e625-4982-973f-0238449bc014'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:21.434032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] The token cache is being invalidate because project 72ebda3c71fa4afdb922c731d602614d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:23:21.434342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:21.434971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:21.436562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1274/2531] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:23:21 2022] DELETE /identity/v3/projects/72ebda3c71fa4afdb922c731d602614d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:24.068154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:24.069995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:24.129976 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3821b-9e64-4c98-acb3-733859b96e60 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:24.179809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3603392-f526-461c-b5d5-e272f2f37e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:24.180502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3603392-f526-461c-b5d5-e272f2f37e67 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:24.180786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3603392-f526-461c-b5d5-e272f2f37e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:24.181094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3603392-f526-461c-b5d5-e272f2f37e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:24.182901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d3603392-f526-461c-b5d5-e272f2f37e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:24.193215 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3603392-f526-461c-b5d5-e272f2f37e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:24.194643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3603392-f526-461c-b5d5-e272f2f37e67 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:24.203263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1258/2532] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:26.715614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:26.717013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:26.729976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e42899-e625-4982-973f-0238449bc014 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:26.733768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:26.734428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:26.734709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:26.734984 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:26.736679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:26.798384 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:26.799890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:26.809591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1275/2533] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:34.199302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=51,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:36.805106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:42.550309 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3603392-f526-461c-b5d5-e272f2f37e67 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:42.558880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3603392-f526-461c-b5d5-e272f2f37e67 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:42.562477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7416f-b624-4d33-96e4-ceeca7049c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:42.563114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7416f-b624-4d33-96e4-ceeca7049c50 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:42.563409 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7416f-b624-4d33-96e4-ceeca7049c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:42.563684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7416f-b624-4d33-96e4-ceeca7049c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:42.566010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e0d7416f-b624-4d33-96e4-ceeca7049c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:42.628180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7416f-b624-4d33-96e4-ceeca7049c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:42.629606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7416f-b624-4d33-96e4-ceeca7049c50 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:42.639240 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1259/2534] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:46.320819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:46.322614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:46.336084 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae812e0-a465-4566-a8e7-ae097e6d802e service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:46.340948 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:46.341451 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:46.341721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:46.341990 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] PATH_INFO: `/v3/users/0514d3b22d94435196f8bf1eff26699e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:46.356980 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0514d3b22d94435196f8bf1eff26699e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:46.358871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:46.522683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0514d3b22d94435196f8bf1eff26699e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:46.523300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0514d3b22d94435196f8bf1eff26699e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:46.523900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0514d3b22d94435196f8bf1eff26699e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:46.536201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0514d3b22d94435196f8bf1eff26699e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:46.543006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5becfc79-4e41-4d1c-ae2d-dfed3e8d19f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0514d3b22d94435196f8bf1eff26699e'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:46.611173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1276/2535] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:23:46 2022] DELETE /identity/v3/users/0514d3b22d94435196f8bf1eff26699e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:46.898652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7416f-b624-4d33-96e4-ceeca7049c50 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:46.912343 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7416f-b624-4d33-96e4-ceeca7049c50 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:46.968426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:46.969285 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:46.969567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:46.969842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] PATH_INFO: `/v3/projects/ea502039a02d4d5db21dcc41c98a52a5` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:46.980661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea502039a02d4d5db21dcc41c98a52a5)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:46.982876 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:47.108573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea502039a02d4d5db21dcc41c98a52a5', 'request_id': 'req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:47.116453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea502039a02d4d5db21dcc41c98a52a5', 'request_id': 'req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:47.211116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea502039a02d4d5db21dcc41c98a52a5', 'request_id': 'req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:47.225392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] The token cache is being invalidate because project ea502039a02d4d5db21dcc41c98a52a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:23:47.225392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:47.225392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-5aac09eb-490b-490e-bf3c-dd1b49d1b0e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:47.225392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1260/2536] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:23:46 2022] DELETE /identity/v3/projects/ea502039a02d4d5db21dcc41c98a52a5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:47.229956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f4a71-4ef2-4b5d-a5fd-40af5e1b0e56 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:47.230243 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f4a71-4ef2-4b5d-a5fd-40af5e1b0e56 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:47.230542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f4a71-4ef2-4b5d-a5fd-40af5e1b0e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:47.249498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a22f4a71-4ef2-4b5d-a5fd-40af5e1b0e56 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:23:47.250747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a22f4a71-4ef2-4b5d-a5fd-40af5e1b0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:47.317144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1277/2537] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:23:47.324852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc52fe7-c994-4c9f-9a7a-1d5691025e51 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:47.325203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc52fe7-c994-4c9f-9a7a-1d5691025e51 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:47.325536 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc52fe7-c994-4c9f-9a7a-1d5691025e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:47.343364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1cc52fe7-c994-4c9f-9a7a-1d5691025e51 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:23:47.344556 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1cc52fe7-c994-4c9f-9a7a-1d5691025e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:47.352818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1261/2538] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:23:47.357341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f4a71-4ef2-4b5d-a5fd-40af5e1b0e56 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:47.367040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f4a71-4ef2-4b5d-a5fd-40af5e1b0e56 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:47.371618 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afae4e-aa01-46fa-890b-52934a3edc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:47.372269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afae4e-aa01-46fa-890b-52934a3edc1f admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:47.372549 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afae4e-aa01-46fa-890b-52934a3edc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:47.372823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afae4e-aa01-46fa-890b-52934a3edc1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:47.373540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afae4e-aa01-46fa-890b-52934a3edc1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:23:47.373850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afae4e-aa01-46fa-890b-52934a3edc1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:47.375463 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afae4e-aa01-46fa-890b-52934a3edc1f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:47.387267 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1278/2539] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:23:47.391490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc52fe7-c994-4c9f-9a7a-1d5691025e51 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:47.401246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc52fe7-c994-4c9f-9a7a-1d5691025e51 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:47.405759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb672bb-8b5d-4cd4-a8ac-877980f5731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:47.406425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb672bb-8b5d-4cd4-a8ac-877980f5731c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:47.406700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb672bb-8b5d-4cd4-a8ac-877980f5731c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:47.406968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb672bb-8b5d-4cd4-a8ac-877980f5731c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:47.407684 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb672bb-8b5d-4cd4-a8ac-877980f5731c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:47.409604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb672bb-8b5d-4cd4-a8ac-877980f5731c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:47.413598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:47.493115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1262/2540] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:23:47 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:23:47.497052 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afae4e-aa01-46fa-890b-52934a3edc1f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:47.507730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afae4e-aa01-46fa-890b-52934a3edc1f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:47.551749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:47.564081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1be25-1219-4234-aba7-83a319cdd95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:47.564749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1be25-1219-4234-aba7-83a319cdd95f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:47.565628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1be25-1219-4234-aba7-83a319cdd95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:47.565907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1be25-1219-4234-aba7-83a319cdd95f admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:47.566591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1be25-1219-4234-aba7-83a319cdd95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:47.568526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1be25-1219-4234-aba7-83a319cdd95f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:47.662753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1279/2541] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:23:47 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:23:47.667025 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb672bb-8b5d-4cd4-a8ac-877980f5731c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:47.677957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb672bb-8b5d-4cd4-a8ac-877980f5731c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:47.682523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baadc3-2b11-45fc-9a5a-670112e52d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:47.683206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baadc3-2b11-45fc-9a5a-670112e52d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:47.683488 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baadc3-2b11-45fc-9a5a-670112e52d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:47.683784 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baadc3-2b11-45fc-9a5a-670112e52d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:47.684555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baadc3-2b11-45fc-9a5a-670112e52d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:47.686142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baadc3-2b11-45fc-9a5a-670112e52d61 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:47.696700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1263/2542] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:23:47.700462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1be25-1219-4234-aba7-83a319cdd95f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:47.710483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1be25-1219-4234-aba7-83a319cdd95f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:47.715235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666c1b8-c1f0-450f-b50c-99afcd31e426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:47.715917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c1b8-c1f0-450f-b50c-99afcd31e426 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:47.716201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c1b8-c1f0-450f-b50c-99afcd31e426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:47.716478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c1b8-c1f0-450f-b50c-99afcd31e426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:47.717230 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666c1b8-c1f0-450f-b50c-99afcd31e426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:47.718802 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666c1b8-c1f0-450f-b50c-99afcd31e426 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:47.729174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1280/2543] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:23:47.738404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baadc3-2b11-45fc-9a5a-670112e52d61 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:47.748213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baadc3-2b11-45fc-9a5a-670112e52d61 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:47.753268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eae25d-f40b-4e2c-9391-73b61e4536ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:47.754124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae25d-f40b-4e2c-9391-73b61e4536ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:47.754396 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae25d-f40b-4e2c-9391-73b61e4536ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:47.754660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae25d-f40b-4e2c-9391-73b61e4536ee admin admin] PATH_INFO: `/v3/projects/976ba9ecf8d44069a6a6a9a875bbc439/users/7879f5776d6a42a49bf099480d5f6c41/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:47.769016 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eae25d-f40b-4e2c-9391-73b61e4536ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=976ba9ecf8d44069a6a6a9a875bbc439, user_id=7879f5776d6a42a49bf099480d5f6c41, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:47.771659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eae25d-f40b-4e2c-9391-73b61e4536ee admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:47.839945 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1264/2544] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:23:47 2022] PUT /identity/v3/projects/976ba9ecf8d44069a6a6a9a875bbc439/users/7879f5776d6a42a49bf099480d5f6c41/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:47.851183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488b89-560c-4097-b27b-0aa02f6742e6 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:47.851476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488b89-560c-4097-b27b-0aa02f6742e6 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:47.851757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488b89-560c-4097-b27b-0aa02f6742e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:47.878365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fb488b89-560c-4097-b27b-0aa02f6742e6 None None] MFA Rules not processed for user `7879f5776d6a42a49bf099480d5f6c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:23:47.879598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fb488b89-560c-4097-b27b-0aa02f6742e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:47.942365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1281/2545] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:23:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:23:47.953268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eae25d-f40b-4e2c-9391-73b61e4536ee admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:47.954978 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-12eae25d-f40b-4e2c-9391-73b61e4536ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:48.027107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eae25d-f40b-4e2c-9391-73b61e4536ee admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:48.032686 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d4ba6-0b09-4159-871a-9181000218f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:48.033326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4ba6-0b09-4159-871a-9181000218f0 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:48.034099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4ba6-0b09-4159-871a-9181000218f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:48.034377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4ba6-0b09-4159-871a-9181000218f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:48.042060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d4ba6-0b09-4159-871a-9181000218f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:48.043672 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d4ba6-0b09-4159-871a-9181000218f0 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:48.052954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1265/2546] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:57.939649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:58.048359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:58.165270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb488b89-560c-4097-b27b-0aa02f6742e6 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:58.223660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb488b89-560c-4097-b27b-0aa02f6742e6 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:58.228048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:58.228909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:58.229188 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:58.229457 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] PATH_INFO: `/v3/users/7879f5776d6a42a49bf099480d5f6c41` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:58.230872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7879f5776d6a42a49bf099480d5f6c41)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:58.232790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:58.390877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7879f5776d6a42a49bf099480d5f6c41'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:58.391557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7879f5776d6a42a49bf099480d5f6c41'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:58.392213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7879f5776d6a42a49bf099480d5f6c41'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:58.404928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7879f5776d6a42a49bf099480d5f6c41'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:58.411852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7879f5776d6a42a49bf099480d5f6c41'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:58.501512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1282/2547] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:23:58 2022] DELETE /identity/v3/users/7879f5776d6a42a49bf099480d5f6c41 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:58.506485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967b986-9d73-48cd-928d-3d77efd43090 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:58.506823 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967b986-9d73-48cd-928d-3d77efd43090 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:58.507164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967b986-9d73-48cd-928d-3d77efd43090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:58.524708 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8967b986-9d73-48cd-928d-3d77efd43090 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:23:58.528584 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8967b986-9d73-48cd-928d-3d77efd43090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:58.584392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1266/2548] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:23:58.594166 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:58.595669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:58.651905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7d452-26c0-4a59-8cd7-b75f22180db2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:58.655574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab07743-4da6-4151-852b-157140940dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:58.656215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab07743-4da6-4151-852b-157140940dba service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:58.656498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab07743-4da6-4151-852b-157140940dba service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:58.656771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab07743-4da6-4151-852b-157140940dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:58.665623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab07743-4da6-4151-852b-157140940dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:58.667117 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab07743-4da6-4151-852b-157140940dba service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:58.676907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1283/2549] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:59.086236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967b986-9d73-48cd-928d-3d77efd43090 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:59.088624 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8967b986-9d73-48cd-928d-3d77efd43090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:59.100286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967b986-9d73-48cd-928d-3d77efd43090 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:59.105861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:59.106800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.107079 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.107390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] PATH_INFO: `/v3/projects/976ba9ecf8d44069a6a6a9a875bbc439` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.108610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976ba9ecf8d44069a6a6a9a875bbc439)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:59.110523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:59.210985 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976ba9ecf8d44069a6a6a9a875bbc439', 'request_id': 'req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:59.217401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976ba9ecf8d44069a6a6a9a875bbc439', 'request_id': 'req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:59.308355 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976ba9ecf8d44069a6a6a9a875bbc439', 'request_id': 'req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:59.319581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] The token cache is being invalidate because project 976ba9ecf8d44069a6a6a9a875bbc439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:23:59.319872 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:59.320494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c9aca16d-7c6b-4f9c-9110-8b2ef2b35e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:59.322054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1267/2550] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:23:59 2022] DELETE /identity/v3/projects/976ba9ecf8d44069a6a6a9a875bbc439 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:59.326867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55629d-85b3-468b-8596-c15f381aa92d None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.327357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55629d-85b3-468b-8596-c15f381aa92d None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.327477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55629d-85b3-468b-8596-c15f381aa92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.344808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cb55629d-85b3-468b-8596-c15f381aa92d None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:23:59.345943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cb55629d-85b3-468b-8596-c15f381aa92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:59.363138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:59.405221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1284/2551] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:23:59.416390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e5e1-8cf4-42b7-b614-a1eed05d7841 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.416673 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e5e1-8cf4-42b7-b614-a1eed05d7841 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.416947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e5e1-8cf4-42b7-b614-a1eed05d7841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.434923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0bc8e5e1-8cf4-42b7-b614-a1eed05d7841 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:23:59.438171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0bc8e5e1-8cf4-42b7-b614-a1eed05d7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:59.443942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1268/2552] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:23:59.448003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55629d-85b3-468b-8596-c15f381aa92d None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:59.458087 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55629d-85b3-468b-8596-c15f381aa92d None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:59.463124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85039d7-ec41-4ba0-99c6-1281816069f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:59.463762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85039d7-ec41-4ba0-99c6-1281816069f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.464042 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85039d7-ec41-4ba0-99c6-1281816069f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.464410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85039d7-ec41-4ba0-99c6-1281816069f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.465123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85039d7-ec41-4ba0-99c6-1281816069f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:23:59.465427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85039d7-ec41-4ba0-99c6-1281816069f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:59.466996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85039d7-ec41-4ba0-99c6-1281816069f4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:59.478909 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1285/2553] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:23:59.483294 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8e5e1-8cf4-42b7-b614-a1eed05d7841 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:59.492421 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8e5e1-8cf4-42b7-b614-a1eed05d7841 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:59.497040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f580e3-cf99-422f-8c5c-7bebec9d353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:59.497677 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f580e3-cf99-422f-8c5c-7bebec9d353b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.497959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f580e3-cf99-422f-8c5c-7bebec9d353b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.498266 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f580e3-cf99-422f-8c5c-7bebec9d353b admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.498954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f580e3-cf99-422f-8c5c-7bebec9d353b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:59.500870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f580e3-cf99-422f-8c5c-7bebec9d353b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:59.612806 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1269/2554] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:23:59 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:23:59.616837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85039d7-ec41-4ba0-99c6-1281816069f4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:59.626769 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85039d7-ec41-4ba0-99c6-1281816069f4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:59.682348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf1534-83aa-4921-83fa-91fe0b0049f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:59.683014 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf1534-83aa-4921-83fa-91fe0b0049f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.683328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf1534-83aa-4921-83fa-91fe0b0049f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.683606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf1534-83aa-4921-83fa-91fe0b0049f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.684329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf1534-83aa-4921-83fa-91fe0b0049f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:59.686224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf1534-83aa-4921-83fa-91fe0b0049f4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:59.748216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1286/2555] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:23:59 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:23:59.752314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f580e3-cf99-422f-8c5c-7bebec9d353b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:59.763333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f580e3-cf99-422f-8c5c-7bebec9d353b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:59.768149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbc0a4-4c24-43f2-9d4e-afe67d582a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:59.768808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbc0a4-4c24-43f2-9d4e-afe67d582a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.769091 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbc0a4-4c24-43f2-9d4e-afe67d582a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.769392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbc0a4-4c24-43f2-9d4e-afe67d582a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.770804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbc0a4-4c24-43f2-9d4e-afe67d582a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:59.772442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbc0a4-4c24-43f2-9d4e-afe67d582a74 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:59.782808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1270/2556] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:23:59.786672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf1534-83aa-4921-83fa-91fe0b0049f4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:59.796292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf1534-83aa-4921-83fa-91fe0b0049f4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:59.800960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835f025-137c-42e4-a84c-e9980f369402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:59.801611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835f025-137c-42e4-a84c-e9980f369402 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.801893 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835f025-137c-42e4-a84c-e9980f369402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.802167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835f025-137c-42e4-a84c-e9980f369402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.802877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835f025-137c-42e4-a84c-e9980f369402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:59.804488 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835f025-137c-42e4-a84c-e9980f369402 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:59.815123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1287/2557] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:23:59.819471 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbc0a4-4c24-43f2-9d4e-afe67d582a74 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:59.829566 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbc0a4-4c24-43f2-9d4e-afe67d582a74 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:59.835003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f3dbe-4889-4c07-840f-d8c48341dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:59.839160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f3dbe-4889-4c07-840f-d8c48341dc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.839160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f3dbe-4889-4c07-840f-d8c48341dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.839160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f3dbe-4889-4c07-840f-d8c48341dc8d admin admin] PATH_INFO: `/v3/projects/48b1ced5e1094222b13ad8eb64a5d09e/users/1c5b084c75a44833bb1432cd77a6c9dc/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.851028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f3dbe-4889-4c07-840f-d8c48341dc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b1ced5e1094222b13ad8eb64a5d09e, user_id=1c5b084c75a44833bb1432cd77a6c9dc, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:59.853700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f3dbe-4889-4c07-840f-d8c48341dc8d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:59.937748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1271/2558] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:23:59 2022] PUT /identity/v3/projects/48b1ced5e1094222b13ad8eb64a5d09e/users/1c5b084c75a44833bb1432cd77a6c9dc/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:59.950083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbdc1a-76e4-4f67-bca0-0cf3118a8e21 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:59.950370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbdc1a-76e4-4f67-bca0-0cf3118a8e21 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:59.950646 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbdc1a-76e4-4f67-bca0-0cf3118a8e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:59.977020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f7bbdc1a-76e4-4f67-bca0-0cf3118a8e21 None None] MFA Rules not processed for user `1c5b084c75a44833bb1432cd77a6c9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:23:59.978214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f7bbdc1a-76e4-4f67-bca0-0cf3118a8e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:00.039904 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1288/2559] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:00.044427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f3dbe-4889-4c07-840f-d8c48341dc8d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:00.065014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:00.106116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f3dbe-4889-4c07-840f-d8c48341dc8d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:00.110816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f50f9-4e74-4ad2-bff3-e9e2d6661460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:00.111499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f50f9-4e74-4ad2-bff3-e9e2d6661460 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:00.111780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f50f9-4e74-4ad2-bff3-e9e2d6661460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:00.112051 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f50f9-4e74-4ad2-bff3-e9e2d6661460 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:00.112768 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f50f9-4e74-4ad2-bff3-e9e2d6661460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:00.115192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f50f9-4e74-4ad2-bff3-e9e2d6661460 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:00.236251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1272/2560] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:00 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:00.240917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbdc1a-76e4-4f67-bca0-0cf3118a8e21 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:00.251468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbdc1a-76e4-4f67-bca0-0cf3118a8e21 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:00.264114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:00.308085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e6fb9-fa0a-4e97-8aa6-b9f72884d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:00.308829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e6fb9-fa0a-4e97-8aa6-b9f72884d1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:00.309106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e6fb9-fa0a-4e97-8aa6-b9f72884d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:00.309381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e6fb9-fa0a-4e97-8aa6-b9f72884d1fd admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:00.310070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e6fb9-fa0a-4e97-8aa6-b9f72884d1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:00.311996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e6fb9-fa0a-4e97-8aa6-b9f72884d1fd admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:00.422674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1289/2561] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:00 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:24:00.427198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f50f9-4e74-4ad2-bff3-e9e2d6661460 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:00.437664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f50f9-4e74-4ad2-bff3-e9e2d6661460 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:00.442939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900768c6-b753-4ba1-9382-fb67e8c3c9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:00.445177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900768c6-b753-4ba1-9382-fb67e8c3c9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:00.445177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900768c6-b753-4ba1-9382-fb67e8c3c9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:00.445177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900768c6-b753-4ba1-9382-fb67e8c3c9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:00.445177 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900768c6-b753-4ba1-9382-fb67e8c3c9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:00.446467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900768c6-b753-4ba1-9382-fb67e8c3c9f6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:00.457113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1273/2562] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:00.461070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e6fb9-fa0a-4e97-8aa6-b9f72884d1fd admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:00.470960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e6fb9-fa0a-4e97-8aa6-b9f72884d1fd admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:00.475543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b7637-8bb8-4c9c-8d2b-fc16d02df9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:00.476413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b7637-8bb8-4c9c-8d2b-fc16d02df9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:00.476692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b7637-8bb8-4c9c-8d2b-fc16d02df9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:00.476964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b7637-8bb8-4c9c-8d2b-fc16d02df9e2 admin admin] PATH_INFO: `/v3/projects/8ca26f4dab7d4649847473d0cd85b5f0/users/7927594902a04b40bad4cfc11f0ed915/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:00.492081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b7637-8bb8-4c9c-8d2b-fc16d02df9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca26f4dab7d4649847473d0cd85b5f0, user_id=7927594902a04b40bad4cfc11f0ed915, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:00.494621 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b7637-8bb8-4c9c-8d2b-fc16d02df9e2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:00.577836 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1290/2563] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:00 2022] PUT /identity/v3/projects/8ca26f4dab7d4649847473d0cd85b5f0/users/7927594902a04b40bad4cfc11f0ed915/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:00.582226 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900768c6-b753-4ba1-9382-fb67e8c3c9f6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:00.593615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900768c6-b753-4ba1-9382-fb67e8c3c9f6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:00.661321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af50d5-f31b-49c1-8f98-f7447f2ab396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:00.661995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af50d5-f31b-49c1-8f98-f7447f2ab396 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:00.662274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af50d5-f31b-49c1-8f98-f7447f2ab396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:00.662550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af50d5-f31b-49c1-8f98-f7447f2ab396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:00.663311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af50d5-f31b-49c1-8f98-f7447f2ab396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:00.664902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af50d5-f31b-49c1-8f98-f7447f2ab396 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:00.674704 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1274/2564] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:00.679676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b7637-8bb8-4c9c-8d2b-fc16d02df9e2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:00.689812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b7637-8bb8-4c9c-8d2b-fc16d02df9e2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:00.694540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb4491-cdf2-4823-8f8c-acf8e0a9b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:00.695540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb4491-cdf2-4823-8f8c-acf8e0a9b6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:00.695827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb4491-cdf2-4823-8f8c-acf8e0a9b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:00.696103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb4491-cdf2-4823-8f8c-acf8e0a9b6ba admin admin] PATH_INFO: `/v3/projects/8ca26f4dab7d4649847473d0cd85b5f0/users/7927594902a04b40bad4cfc11f0ed915/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:00.698167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb4491-cdf2-4823-8f8c-acf8e0a9b6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca26f4dab7d4649847473d0cd85b5f0, user_id=7927594902a04b40bad4cfc11f0ed915, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:00.700828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb4491-cdf2-4823-8f8c-acf8e0a9b6ba admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:00.711272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1291/2565] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:00 2022] PUT /identity/v3/projects/8ca26f4dab7d4649847473d0cd85b5f0/users/7927594902a04b40bad4cfc11f0ed915/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:24:00.723123 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6ad91-80e3-4deb-8271-4f7f10962a44 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:00.723421 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6ad91-80e3-4deb-8271-4f7f10962a44 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:00.723700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6ad91-80e3-4deb-8271-4f7f10962a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:00.751472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-6bc6ad91-80e3-4deb-8271-4f7f10962a44 None None] MFA Rules not processed for user `7927594902a04b40bad4cfc11f0ed915`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:00.752604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6bc6ad91-80e3-4deb-8271-4f7f10962a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:00.820433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1275/2566] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:00.831612 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb4491-cdf2-4823-8f8c-acf8e0a9b6ba admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:00.833311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-74eb4491-cdf2-4823-8f8c-acf8e0a9b6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:00.889321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb4491-cdf2-4823-8f8c-acf8e0a9b6ba admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:00.892902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13bafe-d618-4e93-b323-172393de0647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:00.893530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13bafe-d618-4e93-b323-172393de0647 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:00.893811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13bafe-d618-4e93-b323-172393de0647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:00.894085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13bafe-d618-4e93-b323-172393de0647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:00.903736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13bafe-d618-4e93-b323-172393de0647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:00.905200 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13bafe-d618-4e93-b323-172393de0647 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:00.915085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1292/2567] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:01.760892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6ad91-80e3-4deb-8271-4f7f10962a44 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:01.778226 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:01.822697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6ad91-80e3-4deb-8271-4f7f10962a44 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:01.827303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:01.828162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:01.828443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:01.828719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] PATH_INFO: `/v3/users/1c5b084c75a44833bb1432cd77a6c9dc` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:01.829889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5b084c75a44833bb1432cd77a6c9dc)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:01.831850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:02.024186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5b084c75a44833bb1432cd77a6c9dc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.024853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5b084c75a44833bb1432cd77a6c9dc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.037064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5b084c75a44833bb1432cd77a6c9dc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.043827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5b084c75a44833bb1432cd77a6c9dc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.044451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5b084c75a44833bb1432cd77a6c9dc'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.113863 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1276/2568] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:01 2022] DELETE /identity/v3/users/1c5b084c75a44833bb1432cd77a6c9dc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:02.118262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2abea-e9ab-4520-b0ca-5fec0801694b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:02.118755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2abea-e9ab-4520-b0ca-5fec0801694b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:02.118863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2abea-e9ab-4520-b0ca-5fec0801694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:02.136483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-dfa2abea-e9ab-4520-b0ca-5fec0801694b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:02.137676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dfa2abea-e9ab-4520-b0ca-5fec0801694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:02.195971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1293/2569] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:02.205508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:02.206932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:02.271748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f16413-7b76-4145-a9cb-17713fdbe9cd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:02.275606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d63708-e3af-4f4a-a97b-dfaf019f304d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:02.276256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d63708-e3af-4f4a-a97b-dfaf019f304d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:02.276538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d63708-e3af-4f4a-a97b-dfaf019f304d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:02.276817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d63708-e3af-4f4a-a97b-dfaf019f304d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:02.286709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d63708-e3af-4f4a-a97b-dfaf019f304d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:02.288168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d63708-e3af-4f4a-a97b-dfaf019f304d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:02.297756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1277/2570] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:02.664720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2abea-e9ab-4520-b0ca-5fec0801694b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:02.666184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-dfa2abea-e9ab-4520-b0ca-5fec0801694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:02.679629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2abea-e9ab-4520-b0ca-5fec0801694b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:02.684395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:02.685262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:02.685552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:02.685828 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] PATH_INFO: `/v3/projects/48b1ced5e1094222b13ad8eb64a5d09e` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:02.687067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b1ced5e1094222b13ad8eb64a5d09e)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:02.688986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:02.697523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:02.804691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b1ced5e1094222b13ad8eb64a5d09e', 'request_id': 'req-8eeaae7c-7f0a-4514-9787-c8d4280052f0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.810674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b1ced5e1094222b13ad8eb64a5d09e', 'request_id': 'req-8eeaae7c-7f0a-4514-9787-c8d4280052f0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.896873 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b1ced5e1094222b13ad8eb64a5d09e', 'request_id': 'req-8eeaae7c-7f0a-4514-9787-c8d4280052f0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.909002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] The token cache is being invalidate because project 48b1ced5e1094222b13ad8eb64a5d09e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:24:02.909002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.909002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:02.910045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1294/2571] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:24:02 2022] DELETE /identity/v3/projects/48b1ced5e1094222b13ad8eb64a5d09e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:02.914163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d63708-e3af-4f4a-a97b-dfaf019f304d service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:02.923852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d63708-e3af-4f4a-a97b-dfaf019f304d service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:02.958306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:02.980918 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:02.986592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:02.986592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:02.986592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] PATH_INFO: `/v3/users/7927594902a04b40bad4cfc11f0ed915` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:02.986592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7927594902a04b40bad4cfc11f0ed915)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:02.986592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:03.133381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7927594902a04b40bad4cfc11f0ed915'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.134103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7927594902a04b40bad4cfc11f0ed915'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.146518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7927594902a04b40bad4cfc11f0ed915'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.153532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7927594902a04b40bad4cfc11f0ed915'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.158539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2295336f-d98f-46e7-a3d8-98c6dca0cb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7927594902a04b40bad4cfc11f0ed915'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.234418 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1278/2572] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:02 2022] DELETE /identity/v3/users/7927594902a04b40bad4cfc11f0ed915 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:03.612802 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:03.614282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:03.627280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaae7c-7f0a-4514-9787-c8d4280052f0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:03.684027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:03.684884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:03.685159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:03.685423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] PATH_INFO: `/v3/projects/8ca26f4dab7d4649847473d0cd85b5f0` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:03.686576 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca26f4dab7d4649847473d0cd85b5f0)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:03.688477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:03.782683 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca26f4dab7d4649847473d0cd85b5f0', 'request_id': 'req-21cf48e1-3aba-467e-b476-d0422b2827c1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.788854 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca26f4dab7d4649847473d0cd85b5f0', 'request_id': 'req-21cf48e1-3aba-467e-b476-d0422b2827c1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.833782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca26f4dab7d4649847473d0cd85b5f0', 'request_id': 'req-21cf48e1-3aba-467e-b476-d0422b2827c1'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.843932 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] The token cache is being invalidate because project 8ca26f4dab7d4649847473d0cd85b5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:24:03.844217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.844856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-21cf48e1-3aba-467e-b476-d0422b2827c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:03.846408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1295/2573] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:24:03 2022] DELETE /identity/v3/projects/8ca26f4dab7d4649847473d0cd85b5f0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:03.851443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f0c15-8cff-4e99-9b2c-5cd8c4ddebb0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:03.851732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f0c15-8cff-4e99-9b2c-5cd8c4ddebb0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:03.852035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f0c15-8cff-4e99-9b2c-5cd8c4ddebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:03.869875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ba2f0c15-8cff-4e99-9b2c-5cd8c4ddebb0 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:03.871045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ba2f0c15-8cff-4e99-9b2c-5cd8c4ddebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:03.929080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1279/2574] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:24:03.936874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeb491-3cd9-4b7b-b302-bb9ea40c2f7c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:03.937160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeb491-3cd9-4b7b-b302-bb9ea40c2f7c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:03.937435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeb491-3cd9-4b7b-b302-bb9ea40c2f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:03.955661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-0caeb491-3cd9-4b7b-b302-bb9ea40c2f7c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:03.956862 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0caeb491-3cd9-4b7b-b302-bb9ea40c2f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:03.964603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1296/2575] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:03.968565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f0c15-8cff-4e99-9b2c-5cd8c4ddebb0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:03.978272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f0c15-8cff-4e99-9b2c-5cd8c4ddebb0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:03.983207 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575bff1-6023-4b75-99fa-87726f1d49e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:03.983853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575bff1-6023-4b75-99fa-87726f1d49e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:03.984132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575bff1-6023-4b75-99fa-87726f1d49e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:03.984402 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575bff1-6023-4b75-99fa-87726f1d49e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:03.985118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575bff1-6023-4b75-99fa-87726f1d49e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:24:03.985425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575bff1-6023-4b75-99fa-87726f1d49e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:03.987012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575bff1-6023-4b75-99fa-87726f1d49e3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:03.998971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1280/2576] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:24:04.003012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caeb491-3cd9-4b7b-b302-bb9ea40c2f7c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.012727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caeb491-3cd9-4b7b-b302-bb9ea40c2f7c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.017326 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd4b1f-eccd-4966-901b-6485bae7aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.017967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd4b1f-eccd-4966-901b-6485bae7aeae admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.018250 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd4b1f-eccd-4966-901b-6485bae7aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.018526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd4b1f-eccd-4966-901b-6485bae7aeae admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.019301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd4b1f-eccd-4966-901b-6485bae7aeae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.021171 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd4b1f-eccd-4966-901b-6485bae7aeae admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:04.103240 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:04.110866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1297/2577] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:04 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:04.115722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575bff1-6023-4b75-99fa-87726f1d49e3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.125793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575bff1-6023-4b75-99fa-87726f1d49e3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.167681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:04.182750 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dac8e-1e83-429a-a5cb-3a63ffcaf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.183471 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dac8e-1e83-429a-a5cb-3a63ffcaf64b admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.183754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dac8e-1e83-429a-a5cb-3a63ffcaf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.184096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dac8e-1e83-429a-a5cb-3a63ffcaf64b admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.184788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dac8e-1e83-429a-a5cb-3a63ffcaf64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.186690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dac8e-1e83-429a-a5cb-3a63ffcaf64b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:04.260660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1281/2578] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:04 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:04.262631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd4b1f-eccd-4966-901b-6485bae7aeae admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.273431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd4b1f-eccd-4966-901b-6485bae7aeae admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.277965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e5c9-9e4b-482b-88cd-b39d603ef879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.278666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e5c9-9e4b-482b-88cd-b39d603ef879 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.278977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e5c9-9e4b-482b-88cd-b39d603ef879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.279282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e5c9-9e4b-482b-88cd-b39d603ef879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.280039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59e5c9-9e4b-482b-88cd-b39d603ef879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.281821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59e5c9-9e4b-482b-88cd-b39d603ef879 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:04.293310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1298/2579] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:04.297371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dac8e-1e83-429a-a5cb-3a63ffcaf64b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.307852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dac8e-1e83-429a-a5cb-3a63ffcaf64b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.312360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e275d6-bfb6-4ebc-9e52-38b5ba14e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.313213 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e275d6-bfb6-4ebc-9e52-38b5ba14e468 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.313483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e275d6-bfb6-4ebc-9e52-38b5ba14e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.313778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e275d6-bfb6-4ebc-9e52-38b5ba14e468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.314788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e275d6-bfb6-4ebc-9e52-38b5ba14e468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.316073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e275d6-bfb6-4ebc-9e52-38b5ba14e468 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:04.326258 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1282/2580] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:04.330354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e5c9-9e4b-482b-88cd-b39d603ef879 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.340805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e5c9-9e4b-482b-88cd-b39d603ef879 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.345772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11363e3-ebf8-4aea-962d-30bc18af5371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.346653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11363e3-ebf8-4aea-962d-30bc18af5371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.346931 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11363e3-ebf8-4aea-962d-30bc18af5371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.347291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11363e3-ebf8-4aea-962d-30bc18af5371 admin admin] PATH_INFO: `/v3/projects/8aac854caf164bdc966e18664748aacd/users/5eefd3d59b6e45b48f60292f118af851/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.362513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11363e3-ebf8-4aea-962d-30bc18af5371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aac854caf164bdc966e18664748aacd, user_id=5eefd3d59b6e45b48f60292f118af851, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.365729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11363e3-ebf8-4aea-962d-30bc18af5371 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:04.411550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1299/2581] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:04 2022] PUT /identity/v3/projects/8aac854caf164bdc966e18664748aacd/users/5eefd3d59b6e45b48f60292f118af851/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:04.421720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec357-85a4-40f6-8c4c-b10a99951a72 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.422008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec357-85a4-40f6-8c4c-b10a99951a72 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.422284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec357-85a4-40f6-8c4c-b10a99951a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.448644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-478ec357-85a4-40f6-8c4c-b10a99951a72 None None] MFA Rules not processed for user `5eefd3d59b6e45b48f60292f118af851`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:04.452021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-478ec357-85a4-40f6-8c4c-b10a99951a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:04.512890 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1283/2582] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:04.517270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11363e3-ebf8-4aea-962d-30bc18af5371 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.577144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11363e3-ebf8-4aea-962d-30bc18af5371 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.581757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a5e9c-6fbd-4f52-b0f2-acc24a6a6780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.582413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a5e9c-6fbd-4f52-b0f2-acc24a6a6780 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.582699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a5e9c-6fbd-4f52-b0f2-acc24a6a6780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.582976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a5e9c-6fbd-4f52-b0f2-acc24a6a6780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.583685 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a5e9c-6fbd-4f52-b0f2-acc24a6a6780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.585572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a5e9c-6fbd-4f52-b0f2-acc24a6a6780 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:04.692631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1300/2583] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:04 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:04.696468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ec357-85a4-40f6-8c4c-b10a99951a72 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.707824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ec357-85a4-40f6-8c4c-b10a99951a72 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.763036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e325e1-3d30-4130-be27-c962743bbeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.763729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e325e1-3d30-4130-be27-c962743bbeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.764013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e325e1-3d30-4130-be27-c962743bbeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.764291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e325e1-3d30-4130-be27-c962743bbeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.764971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e325e1-3d30-4130-be27-c962743bbeb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.766890 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e325e1-3d30-4130-be27-c962743bbeb8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:04.828029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1284/2584] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:04 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:04.832547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a5e9c-6fbd-4f52-b0f2-acc24a6a6780 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.842704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a5e9c-6fbd-4f52-b0f2-acc24a6a6780 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.847357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032104c6-6b00-422f-8186-f679c37b69d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.848676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032104c6-6b00-422f-8186-f679c37b69d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.848956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032104c6-6b00-422f-8186-f679c37b69d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.849224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032104c6-6b00-422f-8186-f679c37b69d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.849942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032104c6-6b00-422f-8186-f679c37b69d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.851562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032104c6-6b00-422f-8186-f679c37b69d9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:04.862143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1301/2585] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:04.866028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e325e1-3d30-4130-be27-c962743bbeb8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.876003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e325e1-3d30-4130-be27-c962743bbeb8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.880571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce77ae-0bb8-4a4f-a8bf-03dff21f58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.881218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce77ae-0bb8-4a4f-a8bf-03dff21f58d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.881502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce77ae-0bb8-4a4f-a8bf-03dff21f58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.881775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce77ae-0bb8-4a4f-a8bf-03dff21f58d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.882490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce77ae-0bb8-4a4f-a8bf-03dff21f58d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.884095 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce77ae-0bb8-4a4f-a8bf-03dff21f58d9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:04.893929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1285/2586] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:04.897987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032104c6-6b00-422f-8186-f679c37b69d9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:04.907676 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032104c6-6b00-422f-8186-f679c37b69d9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:04.912849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5891a4-ee89-4ca5-b81e-ec61b0f1cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:04.913703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5891a4-ee89-4ca5-b81e-ec61b0f1cc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:04.913978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5891a4-ee89-4ca5-b81e-ec61b0f1cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:04.914247 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5891a4-ee89-4ca5-b81e-ec61b0f1cc0a admin admin] PATH_INFO: `/v3/projects/1e5f08f9b4b64ca29ca98db0b2fad4bc/users/d2182b77910a422ebe31cb617eefc9f2/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:04.928251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5891a4-ee89-4ca5-b81e-ec61b0f1cc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5f08f9b4b64ca29ca98db0b2fad4bc, user_id=d2182b77910a422ebe31cb617eefc9f2, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:04.930877 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5891a4-ee89-4ca5-b81e-ec61b0f1cc0a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:05.010589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1302/2587] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:04 2022] PUT /identity/v3/projects/1e5f08f9b4b64ca29ca98db0b2fad4bc/users/d2182b77910a422ebe31cb617eefc9f2/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:24:05.022102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae968e-1bda-4732-b9d0-8cbe88604ba0 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:05.025131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae968e-1bda-4732-b9d0-8cbe88604ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:05.025131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae968e-1bda-4732-b9d0-8cbe88604ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:05.051321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-41ae968e-1bda-4732-b9d0-8cbe88604ba0 None None] MFA Rules not processed for user `d2182b77910a422ebe31cb617eefc9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:05.052534 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-41ae968e-1bda-4732-b9d0-8cbe88604ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:05.071036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:05.117315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1286/2588] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:05.121745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5891a4-ee89-4ca5-b81e-ec61b0f1cc0a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:05.182700 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5891a4-ee89-4ca5-b81e-ec61b0f1cc0a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:05.187338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8aa326-7006-457a-a555-5e52fa3abe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:05.187994 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8aa326-7006-457a-a555-5e52fa3abe1a admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:05.188277 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8aa326-7006-457a-a555-5e52fa3abe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:05.188553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8aa326-7006-457a-a555-5e52fa3abe1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:05.189241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8aa326-7006-457a-a555-5e52fa3abe1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:05.191671 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8aa326-7006-457a-a555-5e52fa3abe1a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:05.268562 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:05.276170 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1303/2589] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:05 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:05.280232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae968e-1bda-4732-b9d0-8cbe88604ba0 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:05.291204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae968e-1bda-4732-b9d0-8cbe88604ba0 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:05.347639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497683-0db7-43ec-86b1-78c26c4b10bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:05.348315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497683-0db7-43ec-86b1-78c26c4b10bd admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:05.348594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497683-0db7-43ec-86b1-78c26c4b10bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:05.348870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497683-0db7-43ec-86b1-78c26c4b10bd admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:05.349589 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f497683-0db7-43ec-86b1-78c26c4b10bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:05.351559 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f497683-0db7-43ec-86b1-78c26c4b10bd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:05.439371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1287/2590] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:05 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:05.443844 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8aa326-7006-457a-a555-5e52fa3abe1a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:05.454127 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8aa326-7006-457a-a555-5e52fa3abe1a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:05.458771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7350b-f71a-466c-98b6-6866bc765513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:05.459464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7350b-f71a-466c-98b6-6866bc765513 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:05.459750 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7350b-f71a-466c-98b6-6866bc765513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:05.460072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7350b-f71a-466c-98b6-6866bc765513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:05.460793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7350b-f71a-466c-98b6-6866bc765513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:05.462371 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7350b-f71a-466c-98b6-6866bc765513 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:05.473013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1304/2591] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:05.477026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497683-0db7-43ec-86b1-78c26c4b10bd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:05.487124 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497683-0db7-43ec-86b1-78c26c4b10bd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:05.492348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6af30-d5ae-4dc9-b13c-27336e586f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:05.493216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6af30-d5ae-4dc9-b13c-27336e586f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:05.493498 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6af30-d5ae-4dc9-b13c-27336e586f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:05.493773 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6af30-d5ae-4dc9-b13c-27336e586f91 admin admin] PATH_INFO: `/v3/projects/1c5e6fbc64ac4491a57017519aa797c3/users/ae28c831fe8b4f18a26b87e3bc3fcee4/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:05.509101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6af30-d5ae-4dc9-b13c-27336e586f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5e6fbc64ac4491a57017519aa797c3, user_id=ae28c831fe8b4f18a26b87e3bc3fcee4, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:05.511770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6af30-d5ae-4dc9-b13c-27336e586f91 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:05.577007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1288/2592] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:05 2022] PUT /identity/v3/projects/1c5e6fbc64ac4491a57017519aa797c3/users/ae28c831fe8b4f18a26b87e3bc3fcee4/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:05.580857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7350b-f71a-466c-98b6-6866bc765513 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:05.590906 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7350b-f71a-466c-98b6-6866bc765513 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:05.646273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5d223-d789-4623-995b-bf6bbabf2957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:05.647066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5d223-d789-4623-995b-bf6bbabf2957 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:05.647376 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5d223-d789-4623-995b-bf6bbabf2957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:05.647675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5d223-d789-4623-995b-bf6bbabf2957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:05.648415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5d223-d789-4623-995b-bf6bbabf2957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:05.650013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5d223-d789-4623-995b-bf6bbabf2957 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:05.659804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1305/2593] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:05.663834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6af30-d5ae-4dc9-b13c-27336e586f91 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:05.673895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6af30-d5ae-4dc9-b13c-27336e586f91 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:05.678924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b1af0-fa10-4330-97d5-9bfcaf96f8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:05.679819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b1af0-fa10-4330-97d5-9bfcaf96f8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:05.680099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b1af0-fa10-4330-97d5-9bfcaf96f8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:05.680372 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b1af0-fa10-4330-97d5-9bfcaf96f8f3 admin admin] PATH_INFO: `/v3/projects/1c5e6fbc64ac4491a57017519aa797c3/users/ae28c831fe8b4f18a26b87e3bc3fcee4/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:05.682308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b1af0-fa10-4330-97d5-9bfcaf96f8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5e6fbc64ac4491a57017519aa797c3, user_id=ae28c831fe8b4f18a26b87e3bc3fcee4, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:05.684990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b1af0-fa10-4330-97d5-9bfcaf96f8f3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:05.695649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1289/2594] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:05 2022] PUT /identity/v3/projects/1c5e6fbc64ac4491a57017519aa797c3/users/ae28c831fe8b4f18a26b87e3bc3fcee4/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:24:05.705876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ea79-b308-436e-a9aa-7d0f9928fa6e None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:05.706368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ea79-b308-436e-a9aa-7d0f9928fa6e None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:05.706487 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ea79-b308-436e-a9aa-7d0f9928fa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:05.732550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bdf2ea79-b308-436e-a9aa-7d0f9928fa6e None None] MFA Rules not processed for user `ae28c831fe8b4f18a26b87e3bc3fcee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:05.733755 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bdf2ea79-b308-436e-a9aa-7d0f9928fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:05.803158 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1306/2595] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:05.813721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b1af0-fa10-4330-97d5-9bfcaf96f8f3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:05.815444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7b1b1af0-fa10-4330-97d5-9bfcaf96f8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:05.872577 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b1af0-fa10-4330-97d5-9bfcaf96f8f3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:05.876142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f74d-704a-4339-878e-3350e45b0dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:05.876780 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f74d-704a-4339-878e-3350e45b0dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:05.877064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f74d-704a-4339-878e-3350e45b0dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:05.877338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f74d-704a-4339-878e-3350e45b0dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:05.886314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f74d-704a-4339-878e-3350e45b0dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:05.887786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f74d-704a-4339-878e-3350e45b0dd7 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:05.897191 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1290/2596] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:06.913193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ea79-b308-436e-a9aa-7d0f9928fa6e None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:06.914572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bdf2ea79-b308-436e-a9aa-7d0f9928fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:06.926736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ea79-b308-436e-a9aa-7d0f9928fa6e None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:06.930278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fee1d-c7fe-4d32-bdfd-6f1b3e7e2814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:06.930910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fee1d-c7fe-4d32-bdfd-6f1b3e7e2814 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:06.931227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fee1d-c7fe-4d32-bdfd-6f1b3e7e2814 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:06.931501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fee1d-c7fe-4d32-bdfd-6f1b3e7e2814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:06.986727 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fee1d-c7fe-4d32-bdfd-6f1b3e7e2814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:06.988751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fee1d-c7fe-4d32-bdfd-6f1b3e7e2814 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:06.997528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1307/2597] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:12.774364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f74d-704a-4339-878e-3350e45b0dd7 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:12.783021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f74d-704a-4339-878e-3350e45b0dd7 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:12.786553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb967758-6f89-4a90-ad23-819925c6420b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:12.787217 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb967758-6f89-4a90-ad23-819925c6420b service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:12.787500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb967758-6f89-4a90-ad23-819925c6420b service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:12.787844 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb967758-6f89-4a90-ad23-819925c6420b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:12.799517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:12.845736 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb967758-6f89-4a90-ad23-819925c6420b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:12.847203 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb967758-6f89-4a90-ad23-819925c6420b service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:12.856404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1291/2598] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:16.738602 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fee1d-c7fe-4d32-bdfd-6f1b3e7e2814 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:16.747343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=100 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:16.799585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fee1d-c7fe-4d32-bdfd-6f1b3e7e2814 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:16.804115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:16.804970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:16.805251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:16.805526 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] PATH_INFO: `/v3/users/5eefd3d59b6e45b48f60292f118af851` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:16.806689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eefd3d59b6e45b48f60292f118af851)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:16.808637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:16.966366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eefd3d59b6e45b48f60292f118af851'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:16.966937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eefd3d59b6e45b48f60292f118af851'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:16.967563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eefd3d59b6e45b48f60292f118af851'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:16.979695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eefd3d59b6e45b48f60292f118af851'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:16.986552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eefd3d59b6e45b48f60292f118af851'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:17.060989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1308/2599] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:16 2022] DELETE /identity/v3/users/5eefd3d59b6e45b48f60292f118af851 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:17.065582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c50ac1-f0a9-4c25-8dde-620b7f2e935e None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:17.066557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c50ac1-f0a9-4c25-8dde-620b7f2e935e None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:17.066653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c50ac1-f0a9-4c25-8dde-620b7f2e935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:17.084028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e2c50ac1-f0a9-4c25-8dde-620b7f2e935e None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:17.085212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e2c50ac1-f0a9-4c25-8dde-620b7f2e935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:17.143072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1292/2600] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:17.153382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:17.154771 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:17.211138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47829e3a-0c9d-416a-a844-1c19e9f45506 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:17.214747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a26a59-ced1-40ba-9ea3-efbeaf4ea91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:17.215440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a26a59-ced1-40ba-9ea3-efbeaf4ea91f service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:17.215722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a26a59-ced1-40ba-9ea3-efbeaf4ea91f service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:17.215995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a26a59-ced1-40ba-9ea3-efbeaf4ea91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:17.225523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a26a59-ced1-40ba-9ea3-efbeaf4ea91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:17.226978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a26a59-ced1-40ba-9ea3-efbeaf4ea91f service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:17.236694 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1309/2601] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:17.628567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c50ac1-f0a9-4c25-8dde-620b7f2e935e None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:17.630611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e2c50ac1-f0a9-4c25-8dde-620b7f2e935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:17.646554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c50ac1-f0a9-4c25-8dde-620b7f2e935e None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:17.648481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:17.649380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:17.649714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:17.650084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] PATH_INFO: `/v3/projects/8aac854caf164bdc966e18664748aacd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:17.651232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aac854caf164bdc966e18664748aacd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:17.653142 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:17.765621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aac854caf164bdc966e18664748aacd', 'request_id': 'req-110c4b3c-5a58-48ac-834a-363a7d4445ac'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:17.771868 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aac854caf164bdc966e18664748aacd', 'request_id': 'req-110c4b3c-5a58-48ac-834a-363a7d4445ac'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:17.839060 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aac854caf164bdc966e18664748aacd', 'request_id': 'req-110c4b3c-5a58-48ac-834a-363a7d4445ac'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:17.849883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] The token cache is being invalidate because project 8aac854caf164bdc966e18664748aacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:24:17.850171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:17.850791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:17.852370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1293/2602] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:24:17 2022] DELETE /identity/v3/projects/8aac854caf164bdc966e18664748aacd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:17.856564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a26a59-ced1-40ba-9ea3-efbeaf4ea91f service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:17.866883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a26a59-ced1-40ba-9ea3-efbeaf4ea91f service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:17.891845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:17.920966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:17.921830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:17.922111 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:17.922383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] PATH_INFO: `/v3/users/d2182b77910a422ebe31cb617eefc9f2` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:17.923584 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2182b77910a422ebe31cb617eefc9f2)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:17.926150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:18.098818 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2182b77910a422ebe31cb617eefc9f2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.099468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2182b77910a422ebe31cb617eefc9f2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.100076 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2182b77910a422ebe31cb617eefc9f2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.112344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2182b77910a422ebe31cb617eefc9f2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.120003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2182b77910a422ebe31cb617eefc9f2'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.193785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1310/2603] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:17 2022] DELETE /identity/v3/users/d2182b77910a422ebe31cb617eefc9f2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:18.556003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:18.557461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:18.570980 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c4b3c-5a58-48ac-834a-363a7d4445ac admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:18.605625 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:18.629154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:18.629986 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:18.630269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:18.630544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] PATH_INFO: `/v3/projects/1e5f08f9b4b64ca29ca98db0b2fad4bc` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:18.631747 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5f08f9b4b64ca29ca98db0b2fad4bc)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:18.633652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:18.776760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5f08f9b4b64ca29ca98db0b2fad4bc', 'request_id': 'req-48d53e44-aad4-439f-a656-7042ca2b9801'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.782943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5f08f9b4b64ca29ca98db0b2fad4bc', 'request_id': 'req-48d53e44-aad4-439f-a656-7042ca2b9801'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.861912 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5f08f9b4b64ca29ca98db0b2fad4bc', 'request_id': 'req-48d53e44-aad4-439f-a656-7042ca2b9801'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.873174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] The token cache is being invalidate because project 1e5f08f9b4b64ca29ca98db0b2fad4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:24:18.873463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.874084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:18.875662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1294/2604] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:24:18 2022] DELETE /identity/v3/projects/1e5f08f9b4b64ca29ca98db0b2fad4bc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:18.879729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:18.881098 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:18.893657 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3bb03-c2d3-413d-b31c-67ec645673eb admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:18.948162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:18.949023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:18.949306 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:18.949577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] PATH_INFO: `/v3/users/ae28c831fe8b4f18a26b87e3bc3fcee4` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:18.950737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae28c831fe8b4f18a26b87e3bc3fcee4)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:18.952656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:19.161820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae28c831fe8b4f18a26b87e3bc3fcee4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.162387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae28c831fe8b4f18a26b87e3bc3fcee4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.163036 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae28c831fe8b4f18a26b87e3bc3fcee4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.165038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:19.175067 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae28c831fe8b4f18a26b87e3bc3fcee4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.181651 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-40750be8-6e53-4692-9537-15062ad05252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae28c831fe8b4f18a26b87e3bc3fcee4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.268679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1311/2605] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:18 2022] DELETE /identity/v3/users/ae28c831fe8b4f18a26b87e3bc3fcee4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:19.681002 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:19.682592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:19.696932 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d53e44-aad4-439f-a656-7042ca2b9801 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:19.756167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:19.757132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:19.757373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:19.757647 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] PATH_INFO: `/v3/projects/1c5e6fbc64ac4491a57017519aa797c3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:19.758860 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5e6fbc64ac4491a57017519aa797c3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:19.760793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:19.855970 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5e6fbc64ac4491a57017519aa797c3', 'request_id': 'req-55d408e6-0579-4b1b-8359-4a5f0156bcc9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.862096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5e6fbc64ac4491a57017519aa797c3', 'request_id': 'req-55d408e6-0579-4b1b-8359-4a5f0156bcc9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.918462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5e6fbc64ac4491a57017519aa797c3', 'request_id': 'req-55d408e6-0579-4b1b-8359-4a5f0156bcc9'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.928346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:19.929185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] The token cache is being invalidate because project 1c5e6fbc64ac4491a57017519aa797c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:24:19.929468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.930084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-55d408e6-0579-4b1b-8359-4a5f0156bcc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:19.931645 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1295/2606] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:24:19 2022] DELETE /identity/v3/projects/1c5e6fbc64ac4491a57017519aa797c3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:19.938507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737c6de-8061-4520-adcb-acdaf7691b80 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:19.938999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737c6de-8061-4520-adcb-acdaf7691b80 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:19.939142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737c6de-8061-4520-adcb-acdaf7691b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:19.957659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1737c6de-8061-4520-adcb-acdaf7691b80 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:19.958861 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1737c6de-8061-4520-adcb-acdaf7691b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:20.017411 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1312/2607] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:20.027822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4d96a-c133-4c74-80e5-bae011797c68 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:20.028107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4d96a-c133-4c74-80e5-bae011797c68 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:20.028382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4d96a-c133-4c74-80e5-bae011797c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:20.048111 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-78b4d96a-c133-4c74-80e5-bae011797c68 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:20.049307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-78b4d96a-c133-4c74-80e5-bae011797c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:20.057138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1296/2608] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:20.061381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737c6de-8061-4520-adcb-acdaf7691b80 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:20.071597 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737c6de-8061-4520-adcb-acdaf7691b80 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:20.076142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09fe6-ff7f-4c82-ad33-c1530aee0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:20.076816 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09fe6-ff7f-4c82-ad33-c1530aee0f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:20.077100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09fe6-ff7f-4c82-ad33-c1530aee0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:20.077375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09fe6-ff7f-4c82-ad33-c1530aee0f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:20.078096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09fe6-ff7f-4c82-ad33-c1530aee0f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:24:20.078433 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09fe6-ff7f-4c82-ad33-c1530aee0f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:20.080077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09fe6-ff7f-4c82-ad33-c1530aee0f50 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:20.093476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1313/2609] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:24:20.097981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4d96a-c133-4c74-80e5-bae011797c68 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:20.107477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4d96a-c133-4c74-80e5-bae011797c68 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:20.112089 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496619e-8213-4cda-8f17-ef32b4fb5ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:20.112726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496619e-8213-4cda-8f17-ef32b4fb5ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:20.113006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496619e-8213-4cda-8f17-ef32b4fb5ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:20.113278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496619e-8213-4cda-8f17-ef32b4fb5ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:20.113964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496619e-8213-4cda-8f17-ef32b4fb5ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:20.115892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496619e-8213-4cda-8f17-ef32b4fb5ed0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:20.223873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1297/2610] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:20 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:24:20.227885 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09fe6-ff7f-4c82-ad33-c1530aee0f50 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:20.237996 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09fe6-ff7f-4c82-ad33-c1530aee0f50 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:20.293902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da55647-c0b0-4e59-8cba-ce8853801b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:20.294626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da55647-c0b0-4e59-8cba-ce8853801b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:20.294911 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da55647-c0b0-4e59-8cba-ce8853801b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:20.295269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da55647-c0b0-4e59-8cba-ce8853801b35 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:20.296003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da55647-c0b0-4e59-8cba-ce8853801b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:20.297943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da55647-c0b0-4e59-8cba-ce8853801b35 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:20.393689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1314/2611] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:20 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:20.397623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496619e-8213-4cda-8f17-ef32b4fb5ed0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:20.407819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496619e-8213-4cda-8f17-ef32b4fb5ed0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:20.412657 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb2863-cd21-4138-9060-aef15db4357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:20.413315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb2863-cd21-4138-9060-aef15db4357b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:20.413598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb2863-cd21-4138-9060-aef15db4357b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:20.413874 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb2863-cd21-4138-9060-aef15db4357b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:20.414629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb2863-cd21-4138-9060-aef15db4357b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:20.416286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb2863-cd21-4138-9060-aef15db4357b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:20.427192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1298/2612] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:20.430834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da55647-c0b0-4e59-8cba-ce8853801b35 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:20.440622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da55647-c0b0-4e59-8cba-ce8853801b35 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:20.445856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd402ae7-f8e0-4b49-8b02-624059acb42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:20.446503 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402ae7-f8e0-4b49-8b02-624059acb42c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:20.446784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402ae7-f8e0-4b49-8b02-624059acb42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:20.447058 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402ae7-f8e0-4b49-8b02-624059acb42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:20.447809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd402ae7-f8e0-4b49-8b02-624059acb42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:20.449403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd402ae7-f8e0-4b49-8b02-624059acb42c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:20.461054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1315/2613] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:20.464947 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb2863-cd21-4138-9060-aef15db4357b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:20.474649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb2863-cd21-4138-9060-aef15db4357b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:20.479078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f043d0-18ae-40b3-ac86-3caf156989fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:20.480272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f043d0-18ae-40b3-ac86-3caf156989fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:20.480555 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f043d0-18ae-40b3-ac86-3caf156989fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:20.480824 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f043d0-18ae-40b3-ac86-3caf156989fe admin admin] PATH_INFO: `/v3/projects/94aabbfa255047e2b1f8c24e67746be3/users/0a87edbae60f4e2795f0d1c0e8062a7d/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:20.495853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f043d0-18ae-40b3-ac86-3caf156989fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=94aabbfa255047e2b1f8c24e67746be3, user_id=0a87edbae60f4e2795f0d1c0e8062a7d, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:20.498448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f043d0-18ae-40b3-ac86-3caf156989fe admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:20.558027 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1299/2614] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:20 2022] PUT /identity/v3/projects/94aabbfa255047e2b1f8c24e67746be3/users/0a87edbae60f4e2795f0d1c0e8062a7d/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:20.569916 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae268087-e208-443b-b2ae-c1fcdb0826d1 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:20.570203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae268087-e208-443b-b2ae-c1fcdb0826d1 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:20.570477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae268087-e208-443b-b2ae-c1fcdb0826d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:20.596417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-ae268087-e208-443b-b2ae-c1fcdb0826d1 None None] MFA Rules not processed for user `0a87edbae60f4e2795f0d1c0e8062a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:20.597605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ae268087-e208-443b-b2ae-c1fcdb0826d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:20.617631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:20.661192 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1316/2615] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:20.672162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f043d0-18ae-40b3-ac86-3caf156989fe admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:20.673826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c6f043d0-18ae-40b3-ac86-3caf156989fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:20.729843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f043d0-18ae-40b3-ac86-3caf156989fe admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:20.733682 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9989a-663b-4dcf-a857-f39ee88eae6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:20.734318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9989a-663b-4dcf-a857-f39ee88eae6a service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:20.734601 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9989a-663b-4dcf-a857-f39ee88eae6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:20.734877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9989a-663b-4dcf-a857-f39ee88eae6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:20.743116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9989a-663b-4dcf-a857-f39ee88eae6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:20.744549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9989a-663b-4dcf-a857-f39ee88eae6a service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:20.753757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1300/2616] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:30.712666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=17 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:30.749303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:32.626853 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae268087-e208-443b-b2ae-c1fcdb0826d1 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:32.688055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae268087-e208-443b-b2ae-c1fcdb0826d1 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:32.693137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:32.694006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:32.694285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:32.694556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] PATH_INFO: `/v3/users/0a87edbae60f4e2795f0d1c0e8062a7d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:32.695745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a87edbae60f4e2795f0d1c0e8062a7d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:32.697665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:32.829135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a87edbae60f4e2795f0d1c0e8062a7d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:32.829773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a87edbae60f4e2795f0d1c0e8062a7d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:32.830390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a87edbae60f4e2795f0d1c0e8062a7d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:32.842162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a87edbae60f4e2795f0d1c0e8062a7d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:32.849403 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a87edbae60f4e2795f0d1c0e8062a7d'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:32.901661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1317/2617] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:32 2022] DELETE /identity/v3/users/0a87edbae60f4e2795f0d1c0e8062a7d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:32.906161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382eb27-eb69-481f-8e2b-fb7242835b74 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:32.906690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382eb27-eb69-481f-8e2b-fb7242835b74 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:32.906690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382eb27-eb69-481f-8e2b-fb7242835b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:32.923799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-f382eb27-eb69-481f-8e2b-fb7242835b74 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:32.925013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f382eb27-eb69-481f-8e2b-fb7242835b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:32.982237 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1301/2618] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:32.992290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:32.993678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:33.048703 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cb7a2-166f-487a-b6cd-cf53cf383bb9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:33.052956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1467900-b7c6-4cda-acd1-ff6301914215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:33.053589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1467900-b7c6-4cda-acd1-ff6301914215 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:33.053871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1467900-b7c6-4cda-acd1-ff6301914215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:33.054143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1467900-b7c6-4cda-acd1-ff6301914215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:33.062911 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1467900-b7c6-4cda-acd1-ff6301914215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:33.064352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1467900-b7c6-4cda-acd1-ff6301914215 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:33.073705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1318/2619] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:33.459083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382eb27-eb69-481f-8e2b-fb7242835b74 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:33.463854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f382eb27-eb69-481f-8e2b-fb7242835b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:33.475786 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382eb27-eb69-481f-8e2b-fb7242835b74 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:33.481615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:33.482468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:33.482751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:33.483156 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] PATH_INFO: `/v3/projects/94aabbfa255047e2b1f8c24e67746be3` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:33.484598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=94aabbfa255047e2b1f8c24e67746be3)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:33.486563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:33.583438 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94aabbfa255047e2b1f8c24e67746be3', 'request_id': 'req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:33.589758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94aabbfa255047e2b1f8c24e67746be3', 'request_id': 'req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:33.633679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94aabbfa255047e2b1f8c24e67746be3', 'request_id': 'req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:33.644759 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] The token cache is being invalidate because project 94aabbfa255047e2b1f8c24e67746be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:24:33.650714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:33.650714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d8950ad2-7833-4b20-8f8c-0fe94ac5e94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:33.650714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1302/2620] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:24:33 2022] DELETE /identity/v3/projects/94aabbfa255047e2b1f8c24e67746be3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:33.652109 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d92539-1259-4823-84e7-4e9fb9edd900 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:33.652567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d92539-1259-4823-84e7-4e9fb9edd900 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:33.652668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d92539-1259-4823-84e7-4e9fb9edd900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:33.669784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-71d92539-1259-4823-84e7-4e9fb9edd900 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:33.670973 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-71d92539-1259-4823-84e7-4e9fb9edd900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:33.687297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:33.729507 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1319/2621] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:33.737253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00d8d0-f069-49e4-a044-c429376eb7bc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:33.737565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00d8d0-f069-49e4-a044-c429376eb7bc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:33.737903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00d8d0-f069-49e4-a044-c429376eb7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:33.756705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2f00d8d0-f069-49e4-a044-c429376eb7bc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:33.759658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2f00d8d0-f069-49e4-a044-c429376eb7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:33.765931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1303/2622] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:33.770684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d92539-1259-4823-84e7-4e9fb9edd900 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:33.780669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d92539-1259-4823-84e7-4e9fb9edd900 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:33.785234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65185efc-74b8-437e-9c0b-3d2c7d6c67b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:33.785875 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65185efc-74b8-437e-9c0b-3d2c7d6c67b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:33.786154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65185efc-74b8-437e-9c0b-3d2c7d6c67b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:33.786426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65185efc-74b8-437e-9c0b-3d2c7d6c67b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:33.787183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65185efc-74b8-437e-9c0b-3d2c7d6c67b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:24:33.787491 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65185efc-74b8-437e-9c0b-3d2c7d6c67b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:33.789068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65185efc-74b8-437e-9c0b-3d2c7d6c67b9 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:33.800276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1320/2623] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:24:33.804327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00d8d0-f069-49e4-a044-c429376eb7bc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:33.813410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00d8d0-f069-49e4-a044-c429376eb7bc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:33.818522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca095d8-d628-49d9-9df1-e2a8e613af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:33.819192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca095d8-d628-49d9-9df1-e2a8e613af7a admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:33.819483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca095d8-d628-49d9-9df1-e2a8e613af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:33.819760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca095d8-d628-49d9-9df1-e2a8e613af7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:33.820440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca095d8-d628-49d9-9df1-e2a8e613af7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:33.822324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca095d8-d628-49d9-9df1-e2a8e613af7a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:33.886656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1304/2624] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:33 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:33.890951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65185efc-74b8-437e-9c0b-3d2c7d6c67b9 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:33.900849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65185efc-74b8-437e-9c0b-3d2c7d6c67b9 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:33.955869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1109d5-2462-4e02-927a-693d2850b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:33.956528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1109d5-2462-4e02-927a-693d2850b817 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:33.956838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1109d5-2462-4e02-927a-693d2850b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:33.957115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1109d5-2462-4e02-927a-693d2850b817 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:33.957803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1109d5-2462-4e02-927a-693d2850b817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:33.959749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1109d5-2462-4e02-927a-693d2850b817 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.044501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1321/2625] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:33 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:34.048674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca095d8-d628-49d9-9df1-e2a8e613af7a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:34.060031 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca095d8-d628-49d9-9df1-e2a8e613af7a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:34.064633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4006ce3-5300-4c9a-ad85-3c24eaccacd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:34.065290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006ce3-5300-4c9a-ad85-3c24eaccacd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.065571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006ce3-5300-4c9a-ad85-3c24eaccacd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.065850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006ce3-5300-4c9a-ad85-3c24eaccacd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.067289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4006ce3-5300-4c9a-ad85-3c24eaccacd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:34.068878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4006ce3-5300-4c9a-ad85-3c24eaccacd7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.079114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1305/2626] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:34.083025 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1109d5-2462-4e02-927a-693d2850b817 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:34.092791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1109d5-2462-4e02-927a-693d2850b817 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:34.097400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b626a-71ac-4441-b743-4a5674ba748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:34.098046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b626a-71ac-4441-b743-4a5674ba748d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.098329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b626a-71ac-4441-b743-4a5674ba748d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.098603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b626a-71ac-4441-b743-4a5674ba748d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.099366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b626a-71ac-4441-b743-4a5674ba748d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:34.100941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b626a-71ac-4441-b743-4a5674ba748d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.110974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1322/2627] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:34.115386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4006ce3-5300-4c9a-ad85-3c24eaccacd7 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:34.125010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4006ce3-5300-4c9a-ad85-3c24eaccacd7 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:34.130160 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8ebff-05b3-4656-9eba-1d40424bca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:34.131019 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8ebff-05b3-4656-9eba-1d40424bca10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.131332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8ebff-05b3-4656-9eba-1d40424bca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.131603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8ebff-05b3-4656-9eba-1d40424bca10 admin admin] PATH_INFO: `/v3/projects/396267e29a6840d8bbbd46e2d76d8bf5/users/90a778a33b0a441589415f273f6f774f/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.145605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8ebff-05b3-4656-9eba-1d40424bca10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396267e29a6840d8bbbd46e2d76d8bf5, user_id=90a778a33b0a441589415f273f6f774f, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:34.148265 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8ebff-05b3-4656-9eba-1d40424bca10 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.256147 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1306/2628] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:34 2022] PUT /identity/v3/projects/396267e29a6840d8bbbd46e2d76d8bf5/users/90a778a33b0a441589415f273f6f774f/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:34.267321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37bd11-6c94-4fb5-9c2e-a342f66707ef None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.267626 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37bd11-6c94-4fb5-9c2e-a342f66707ef None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.267908 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37bd11-6c94-4fb5-9c2e-a342f66707ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.295567 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fb37bd11-6c94-4fb5-9c2e-a342f66707ef None None] MFA Rules not processed for user `90a778a33b0a441589415f273f6f774f`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:34.296841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fb37bd11-6c94-4fb5-9c2e-a342f66707ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:34.363774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1323/2629] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:34.368417 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8ebff-05b3-4656-9eba-1d40424bca10 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:34.389256 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:34.429261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8ebff-05b3-4656-9eba-1d40424bca10 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:34.434521 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e01d3-c158-4bef-bd58-18cab8d3bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:34.435211 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e01d3-c158-4bef-bd58-18cab8d3bfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.435499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e01d3-c158-4bef-bd58-18cab8d3bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.435778 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e01d3-c158-4bef-bd58-18cab8d3bfd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.436500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e01d3-c158-4bef-bd58-18cab8d3bfd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:34.438669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e01d3-c158-4bef-bd58-18cab8d3bfd2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.497662 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1307/2630] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:34 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:34.501493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37bd11-6c94-4fb5-9c2e-a342f66707ef None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:34.512342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37bd11-6c94-4fb5-9c2e-a342f66707ef None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:34.524413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:34.568603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e19c8-eb61-42f9-845d-a25040142b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:34.569202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e19c8-eb61-42f9-845d-a25040142b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.569483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e19c8-eb61-42f9-845d-a25040142b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.569761 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e19c8-eb61-42f9-845d-a25040142b68 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.570454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e19c8-eb61-42f9-845d-a25040142b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:34.572493 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e19c8-eb61-42f9-845d-a25040142b68 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.638108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1324/2631] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:34 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:34.642231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e01d3-c158-4bef-bd58-18cab8d3bfd2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:34.653076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e01d3-c158-4bef-bd58-18cab8d3bfd2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:34.657730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b45fd-77aa-40eb-99d5-1537aa34584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:34.658381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b45fd-77aa-40eb-99d5-1537aa34584b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.658665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b45fd-77aa-40eb-99d5-1537aa34584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.658943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b45fd-77aa-40eb-99d5-1537aa34584b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.659691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b45fd-77aa-40eb-99d5-1537aa34584b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:34.661892 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b45fd-77aa-40eb-99d5-1537aa34584b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.672520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1308/2632] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:34.676382 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e19c8-eb61-42f9-845d-a25040142b68 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:34.686550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e19c8-eb61-42f9-845d-a25040142b68 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:34.691209 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4aad1e-eb28-4467-9879-a5ae861d3434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:34.692077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4aad1e-eb28-4467-9879-a5ae861d3434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.692352 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4aad1e-eb28-4467-9879-a5ae861d3434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.692731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4aad1e-eb28-4467-9879-a5ae861d3434 admin admin] PATH_INFO: `/v3/projects/16e5a15cda264bc1acbe0ebdb770333d/users/bec8beb803d7469b9164921e3134036b/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.707819 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4aad1e-eb28-4467-9879-a5ae861d3434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e5a15cda264bc1acbe0ebdb770333d, user_id=bec8beb803d7469b9164921e3134036b, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:34.710458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4aad1e-eb28-4467-9879-a5ae861d3434 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.775684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1325/2633] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:34 2022] PUT /identity/v3/projects/16e5a15cda264bc1acbe0ebdb770333d/users/bec8beb803d7469b9164921e3134036b/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:34.779620 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b45fd-77aa-40eb-99d5-1537aa34584b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:34.790232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b45fd-77aa-40eb-99d5-1537aa34584b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:34.844761 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64e64-7ee3-4379-966b-cf657f51dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:34.845354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64e64-7ee3-4379-966b-cf657f51dd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.845633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64e64-7ee3-4379-966b-cf657f51dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.845905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64e64-7ee3-4379-966b-cf657f51dd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.846619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64e64-7ee3-4379-966b-cf657f51dd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:34.848835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64e64-7ee3-4379-966b-cf657f51dd1d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.858615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1309/2634] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:34.862754 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4aad1e-eb28-4467-9879-a5ae861d3434 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:34.873049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4aad1e-eb28-4467-9879-a5ae861d3434 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:34.877684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634267b-4b0c-41fd-b52e-272fe9b1e4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:34.878556 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634267b-4b0c-41fd-b52e-272fe9b1e4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.878838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634267b-4b0c-41fd-b52e-272fe9b1e4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.879146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634267b-4b0c-41fd-b52e-272fe9b1e4e0 admin admin] PATH_INFO: `/v3/projects/16e5a15cda264bc1acbe0ebdb770333d/users/bec8beb803d7469b9164921e3134036b/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.881104 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634267b-4b0c-41fd-b52e-272fe9b1e4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e5a15cda264bc1acbe0ebdb770333d, user_id=bec8beb803d7469b9164921e3134036b, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:34.883743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634267b-4b0c-41fd-b52e-272fe9b1e4e0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:34.893768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1326/2635] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:34 2022] PUT /identity/v3/projects/16e5a15cda264bc1acbe0ebdb770333d/users/bec8beb803d7469b9164921e3134036b/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:34.904143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d37b1-5f09-463f-83b0-88101342c9f3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:34.904430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d37b1-5f09-463f-83b0-88101342c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:34.904743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d37b1-5f09-463f-83b0-88101342c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:34.931751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b69d37b1-5f09-463f-83b0-88101342c9f3 None None] MFA Rules not processed for user `bec8beb803d7469b9164921e3134036b`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:34.932968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b69d37b1-5f09-463f-83b0-88101342c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:34.999503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1310/2636] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:35.010519 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634267b-4b0c-41fd-b52e-272fe9b1e4e0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:35.012215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4634267b-4b0c-41fd-b52e-272fe9b1e4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:35.070005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634267b-4b0c-41fd-b52e-272fe9b1e4e0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:35.073674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e552cd-aff7-49ce-87a8-d9c779476de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:35.074310 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e552cd-aff7-49ce-87a8-d9c779476de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:35.074594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e552cd-aff7-49ce-87a8-d9c779476de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:35.074869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e552cd-aff7-49ce-87a8-d9c779476de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:35.129843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e552cd-aff7-49ce-87a8-d9c779476de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:35.131215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e552cd-aff7-49ce-87a8-d9c779476de7 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:35.139902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1327/2637] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:38.048367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d37b1-5f09-463f-83b0-88101342c9f3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:38.066148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:38.110132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d37b1-5f09-463f-83b0-88101342c9f3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:38.115586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:38.116524 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:38.116843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:38.117120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] PATH_INFO: `/v3/users/90a778a33b0a441589415f273f6f774f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:38.118297 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a778a33b0a441589415f273f6f774f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:38.120236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:38.287001 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a778a33b0a441589415f273f6f774f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:38.287563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a778a33b0a441589415f273f6f774f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:38.299452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a778a33b0a441589415f273f6f774f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:38.306325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a778a33b0a441589415f273f6f774f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:38.311134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a778a33b0a441589415f273f6f774f'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:38.376041 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1311/2638] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:38 2022] DELETE /identity/v3/users/90a778a33b0a441589415f273f6f774f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:38.381255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47132-469a-4945-95dc-7c5b10bf2bef None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:38.381752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47132-469a-4945-95dc-7c5b10bf2bef None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:38.381870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47132-469a-4945-95dc-7c5b10bf2bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:38.398791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6aa47132-469a-4945-95dc-7c5b10bf2bef None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:38.400139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6aa47132-469a-4945-95dc-7c5b10bf2bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:38.419064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:38.459421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1328/2639] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:38.469580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:38.471055 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:38.529069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3004-8d68-417d-9c6f-d8abace017f0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:38.532706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533ee6e-bbe2-4eac-a603-2ccd505ad61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:38.533351 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533ee6e-bbe2-4eac-a603-2ccd505ad61c service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:38.533632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533ee6e-bbe2-4eac-a603-2ccd505ad61c service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:38.533905 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533ee6e-bbe2-4eac-a603-2ccd505ad61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:38.543338 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533ee6e-bbe2-4eac-a603-2ccd505ad61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:38.544737 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533ee6e-bbe2-4eac-a603-2ccd505ad61c service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:38.554700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1312/2640] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:38.972162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47132-469a-4945-95dc-7c5b10bf2bef None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:38.973682 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6aa47132-469a-4945-95dc-7c5b10bf2bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:38.988588 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47132-469a-4945-95dc-7c5b10bf2bef None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:38.990867 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:38.991799 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:38.992081 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:38.992353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] PATH_INFO: `/v3/projects/396267e29a6840d8bbbd46e2d76d8bf5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:38.993539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396267e29a6840d8bbbd46e2d76d8bf5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:38.995680 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:39.096269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396267e29a6840d8bbbd46e2d76d8bf5', 'request_id': 'req-e507503f-31d4-442f-9340-fbe769534ae4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.102477 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396267e29a6840d8bbbd46e2d76d8bf5', 'request_id': 'req-e507503f-31d4-442f-9340-fbe769534ae4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.158752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396267e29a6840d8bbbd46e2d76d8bf5', 'request_id': 'req-e507503f-31d4-442f-9340-fbe769534ae4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.169530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] The token cache is being invalidate because project 396267e29a6840d8bbbd46e2d76d8bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:24:39.169812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.170439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.172131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1329/2641] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:24:38 2022] DELETE /identity/v3/projects/396267e29a6840d8bbbd46e2d76d8bf5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:39.176568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533ee6e-bbe2-4eac-a603-2ccd505ad61c service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:39.186106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533ee6e-bbe2-4eac-a603-2ccd505ad61c service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:39.218358 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:39.242227 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:39.243183 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:39.243468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:39.243744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] PATH_INFO: `/v3/users/bec8beb803d7469b9164921e3134036b` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:39.245794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec8beb803d7469b9164921e3134036b)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:39.246954 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:39.395460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec8beb803d7469b9164921e3134036b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.396035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec8beb803d7469b9164921e3134036b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.407935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec8beb803d7469b9164921e3134036b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.414910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec8beb803d7469b9164921e3134036b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.415602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c5b44ac4-abc7-4570-a0bd-8e0a10a0b34f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec8beb803d7469b9164921e3134036b'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:39.484329 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1313/2642] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:39 2022] DELETE /identity/v3/users/bec8beb803d7469b9164921e3134036b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:39.857943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:39.860399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:39.873225 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507503f-31d4-442f-9340-fbe769534ae4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:39.930689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:39.931516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:39.931803 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:39.932073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] PATH_INFO: `/v3/projects/16e5a15cda264bc1acbe0ebdb770333d` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:39.933238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e5a15cda264bc1acbe0ebdb770333d)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:39.935114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:40.044440 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e5a15cda264bc1acbe0ebdb770333d', 'request_id': 'req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:40.045523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:40.051802 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e5a15cda264bc1acbe0ebdb770333d', 'request_id': 'req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:40.106970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e5a15cda264bc1acbe0ebdb770333d', 'request_id': 'req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:40.118542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] The token cache is being invalidate because project 16e5a15cda264bc1acbe0ebdb770333d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:24:40.118830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:40.119479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-70dd5869-cf10-4d76-8cfe-ce0095b4c1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:40.121023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1330/2643] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:24:39 2022] DELETE /identity/v3/projects/16e5a15cda264bc1acbe0ebdb770333d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:40.126049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf631d-cf39-4415-9b08-b1ab86128cd9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.126344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf631d-cf39-4415-9b08-b1ab86128cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.126623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf631d-cf39-4415-9b08-b1ab86128cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:40.149805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-dbdf631d-cf39-4415-9b08-b1ab86128cd9 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:40.149805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dbdf631d-cf39-4415-9b08-b1ab86128cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:40.204928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1314/2644] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:40.213640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15976900-99d7-4743-9045-e2b7a1d32ba2 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.213934 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15976900-99d7-4743-9045-e2b7a1d32ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.214501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15976900-99d7-4743-9045-e2b7a1d32ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:40.234092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-15976900-99d7-4743-9045-e2b7a1d32ba2 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:40.235325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-15976900-99d7-4743-9045-e2b7a1d32ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:40.244375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1331/2645] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:40.248568 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf631d-cf39-4415-9b08-b1ab86128cd9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:40.258833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf631d-cf39-4415-9b08-b1ab86128cd9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:40.265159 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34a52-f72a-42f1-8d67-a4eb861fe790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:40.265972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34a52-f72a-42f1-8d67-a4eb861fe790 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.266251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34a52-f72a-42f1-8d67-a4eb861fe790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.275531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34a52-f72a-42f1-8d67-a4eb861fe790 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:40.275531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34a52-f72a-42f1-8d67-a4eb861fe790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:24:40.275531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34a52-f72a-42f1-8d67-a4eb861fe790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:40.275531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34a52-f72a-42f1-8d67-a4eb861fe790 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:40.281751 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1315/2646] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:24:40.286162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15976900-99d7-4743-9045-e2b7a1d32ba2 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:40.295496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15976900-99d7-4743-9045-e2b7a1d32ba2 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:40.300138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47ab08-5a6e-4edb-9e45-0c6dd2f09cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:40.300826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ab08-5a6e-4edb-9e45-0c6dd2f09cca admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.301108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ab08-5a6e-4edb-9e45-0c6dd2f09cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.301383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ab08-5a6e-4edb-9e45-0c6dd2f09cca admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:40.302106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47ab08-5a6e-4edb-9e45-0c6dd2f09cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:40.304020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47ab08-5a6e-4edb-9e45-0c6dd2f09cca admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:40.372257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1332/2647] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:40 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:40.376499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34a52-f72a-42f1-8d67-a4eb861fe790 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:40.387290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34a52-f72a-42f1-8d67-a4eb861fe790 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:40.428847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:40.443689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a62fe-0395-4ea9-a5f6-120c5d51df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:40.444353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a62fe-0395-4ea9-a5f6-120c5d51df16 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.444635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a62fe-0395-4ea9-a5f6-120c5d51df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.444913 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a62fe-0395-4ea9-a5f6-120c5d51df16 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:40.445591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a62fe-0395-4ea9-a5f6-120c5d51df16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:40.447548 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a62fe-0395-4ea9-a5f6-120c5d51df16 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:40.548134 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1316/2648] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:40 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:40.551881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47ab08-5a6e-4edb-9e45-0c6dd2f09cca admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:40.562692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47ab08-5a6e-4edb-9e45-0c6dd2f09cca admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:40.567942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcafa3-486d-4adf-bbdc-a5ca4dbd23b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:40.568546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcafa3-486d-4adf-bbdc-a5ca4dbd23b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.568830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcafa3-486d-4adf-bbdc-a5ca4dbd23b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.569144 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcafa3-486d-4adf-bbdc-a5ca4dbd23b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:40.569858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcafa3-486d-4adf-bbdc-a5ca4dbd23b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:40.571498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcafa3-486d-4adf-bbdc-a5ca4dbd23b8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:40.583159 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1333/2649] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:40.587175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a62fe-0395-4ea9-a5f6-120c5d51df16 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:40.597473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a62fe-0395-4ea9-a5f6-120c5d51df16 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:40.602481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6b35f-51b5-40f9-9fec-3a5a4b416f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:40.603179 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6b35f-51b5-40f9-9fec-3a5a4b416f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.603464 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6b35f-51b5-40f9-9fec-3a5a4b416f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.603741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6b35f-51b5-40f9-9fec-3a5a4b416f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:40.604467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6b35f-51b5-40f9-9fec-3a5a4b416f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:40.606303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6b35f-51b5-40f9-9fec-3a5a4b416f88 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:40.617420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1317/2650] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:24:40.621396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcafa3-486d-4adf-bbdc-a5ca4dbd23b8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:40.632006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcafa3-486d-4adf-bbdc-a5ca4dbd23b8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:40.636691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fea17-434d-4712-8d3d-33e656050dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:40.637619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fea17-434d-4712-8d3d-33e656050dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.637945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fea17-434d-4712-8d3d-33e656050dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.638221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fea17-434d-4712-8d3d-33e656050dc2 admin admin] PATH_INFO: `/v3/projects/26f7fdbd96a24067874d745482459280/users/656eb9274d854f0089dabdae712bcef0/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:40.654015 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fea17-434d-4712-8d3d-33e656050dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f7fdbd96a24067874d745482459280, user_id=656eb9274d854f0089dabdae712bcef0, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:40.656787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fea17-434d-4712-8d3d-33e656050dc2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:40.753745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1334/2651] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:40 2022] PUT /identity/v3/projects/26f7fdbd96a24067874d745482459280/users/656eb9274d854f0089dabdae712bcef0/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:40.826474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c278f6-02de-4048-b60b-86fb2653f734 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.832249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c278f6-02de-4048-b60b-86fb2653f734 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.832249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c278f6-02de-4048-b60b-86fb2653f734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:40.854448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e1c278f6-02de-4048-b60b-86fb2653f734 None None] MFA Rules not processed for user `656eb9274d854f0089dabdae712bcef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:40.855943 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e1c278f6-02de-4048-b60b-86fb2653f734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:40.920826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1318/2652] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:40.933185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fea17-434d-4712-8d3d-33e656050dc2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:40.934961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-741fea17-434d-4712-8d3d-33e656050dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:40.993253 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fea17-434d-4712-8d3d-33e656050dc2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:40.997066 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4aab-c25a-4782-b89b-00d737ae2429 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbc657ed3ae49dc9d45687c5dde2ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:40.997792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4aab-c25a-4782-b89b-00d737ae2429 service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:40.998068 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4aab-c25a-4782-b89b-00d737ae2429 service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:40.998346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4aab-c25a-4782-b89b-00d737ae2429 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:41.007157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4aab-c25a-4782-b89b-00d737ae2429 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:41.008528 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4aab-c25a-4782-b89b-00d737ae2429 service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:41.017224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1335/2653] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:47.700113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c278f6-02de-4048-b60b-86fb2653f734 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:47.701646 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e1c278f6-02de-4048-b60b-86fb2653f734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:47.791753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c278f6-02de-4048-b60b-86fb2653f734 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:47.795115 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:47.795819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:47.796125 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:47.796401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:47.798545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:47.812028 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:47.813635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:47.826663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1319/2654] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:51.013364 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=59,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:53.034229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4aab-c25a-4782-b89b-00d737ae2429 service glance] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:53.036160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-deff4aab-c25a-4782-b89b-00d737ae2429 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:53.092463 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4aab-c25a-4782-b89b-00d737ae2429 service glance] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:53.096035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:53.096675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:53.096958 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:53.097233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:53.099532 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:53.160895 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:53.162428 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:53.171965 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1336/2655] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:56.708410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:56.709830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:56.754503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:56.781310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbc091-d21b-49de-bc46-3de8d345d2ab service nova] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:56.786278 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdf6a2-55b7-4232-a406-ac1a83ac5986 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:56.786917 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf6a2-55b7-4232-a406-ac1a83ac5986 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:56.787232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf6a2-55b7-4232-a406-ac1a83ac5986 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:56.787510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf6a2-55b7-4232-a406-ac1a83ac5986 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:56.789293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-74bdf6a2-55b7-4232-a406-ac1a83ac5986 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:56.800643 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdf6a2-55b7-4232-a406-ac1a83ac5986 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:56.802247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdf6a2-55b7-4232-a406-ac1a83ac5986 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:56.811995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1320/2656] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:56.851160 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:56.852788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:56.866699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828e283-cfa1-4255-aa4b-f1bf0d4947f0 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:56.871324 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:56.872220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:56.872501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:56.872772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] PATH_INFO: `/v3/users/5a6e44ab0c394541a7d7b290928ea6f8` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:56.888143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6e44ab0c394541a7d7b290928ea6f8)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:56.890055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:57.023851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6e44ab0c394541a7d7b290928ea6f8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.024499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6e44ab0c394541a7d7b290928ea6f8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.025108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6e44ab0c394541a7d7b290928ea6f8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.038147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6e44ab0c394541a7d7b290928ea6f8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.044923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-8a21151f-ac8c-4566-970d-f15b78ae9a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6e44ab0c394541a7d7b290928ea6f8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.095366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1337/2657] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:56 2022] DELETE /identity/v3/users/5a6e44ab0c394541a7d7b290928ea6f8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:57.338002 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdf6a2-55b7-4232-a406-ac1a83ac5986 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:57.348509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdf6a2-55b7-4232-a406-ac1a83ac5986 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:57.426711 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:57.427610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:57.427895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:57.428170 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] PATH_INFO: `/v3/projects/a083c564db474e80af22b7c21af82775` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:57.439038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a083c564db474e80af22b7c21af82775)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:57.440964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:57.519194 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a083c564db474e80af22b7c21af82775', 'request_id': 'req-619691a0-ac45-4581-98b2-84dae7828b89'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.526413 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a083c564db474e80af22b7c21af82775', 'request_id': 'req-619691a0-ac45-4581-98b2-84dae7828b89'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.587311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a083c564db474e80af22b7c21af82775', 'request_id': 'req-619691a0-ac45-4581-98b2-84dae7828b89'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.598185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] The token cache is being invalidate because project a083c564db474e80af22b7c21af82775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:24:57.601442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.601442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-619691a0-ac45-4581-98b2-84dae7828b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:57.601442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1321/2658] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:24:57 2022] DELETE /identity/v3/projects/a083c564db474e80af22b7c21af82775 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:57.605709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01790-fbb6-4d34-908f-619005ca022c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:57.605997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01790-fbb6-4d34-908f-619005ca022c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:57.606272 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01790-fbb6-4d34-908f-619005ca022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:57.623972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-53d01790-fbb6-4d34-908f-619005ca022c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:57.625165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-53d01790-fbb6-4d34-908f-619005ca022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:57.630834 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:57.682951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1338/2659] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:57.690775 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78ed8c-4653-4d4f-96b7-10cbf5937ddc None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:57.691063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78ed8c-4653-4d4f-96b7-10cbf5937ddc None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:57.691900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78ed8c-4653-4d4f-96b7-10cbf5937ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:57.710537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0d78ed8c-4653-4d4f-96b7-10cbf5937ddc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:57.716152 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0d78ed8c-4653-4d4f-96b7-10cbf5937ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:57.719821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1322/2660] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:57.724223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01790-fbb6-4d34-908f-619005ca022c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:57.734061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01790-fbb6-4d34-908f-619005ca022c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:57.740097 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5555b3-5cb3-4649-9cac-38efc0ab7ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:57.740928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5555b3-5cb3-4649-9cac-38efc0ab7ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:57.741307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5555b3-5cb3-4649-9cac-38efc0ab7ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:57.741640 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5555b3-5cb3-4649-9cac-38efc0ab7ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:57.742424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5555b3-5cb3-4649-9cac-38efc0ab7ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:24:57.742793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5555b3-5cb3-4649-9cac-38efc0ab7ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:57.744483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5555b3-5cb3-4649-9cac-38efc0ab7ef7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:57.757252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1339/2661] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:24:57.761664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78ed8c-4653-4d4f-96b7-10cbf5937ddc None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:57.771722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78ed8c-4653-4d4f-96b7-10cbf5937ddc None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:57.776400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df375-5b4a-40ad-a76a-20ac77a7d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:57.777047 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df375-5b4a-40ad-a76a-20ac77a7d073 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:57.777327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df375-5b4a-40ad-a76a-20ac77a7d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:57.777606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df375-5b4a-40ad-a76a-20ac77a7d073 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:57.778290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916df375-5b4a-40ad-a76a-20ac77a7d073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:57.780267 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916df375-5b4a-40ad-a76a-20ac77a7d073 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:57.869481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1323/2662] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:57 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:57.873320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5555b3-5cb3-4649-9cac-38efc0ab7ef7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:57.884227 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5555b3-5cb3-4649-9cac-38efc0ab7ef7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:57.938870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be3ce3-973e-4611-8528-ddc3b0526245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:57.939595 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be3ce3-973e-4611-8528-ddc3b0526245 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:57.939881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be3ce3-973e-4611-8528-ddc3b0526245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:57.940157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be3ce3-973e-4611-8528-ddc3b0526245 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:57.940851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be3ce3-973e-4611-8528-ddc3b0526245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:57.943405 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be3ce3-973e-4611-8528-ddc3b0526245 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.016329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1340/2663] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:57 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:24:58.020827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df375-5b4a-40ad-a76a-20ac77a7d073 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:58.031293 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df375-5b4a-40ad-a76a-20ac77a7d073 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:58.036010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc76ae-2e13-4f8d-a402-adbca62087b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:58.036669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc76ae-2e13-4f8d-a402-adbca62087b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.038119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc76ae-2e13-4f8d-a402-adbca62087b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.038119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc76ae-2e13-4f8d-a402-adbca62087b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.038119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc76ae-2e13-4f8d-a402-adbca62087b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:58.039649 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc76ae-2e13-4f8d-a402-adbca62087b8 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.049544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1324/2664] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:58.053894 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be3ce3-973e-4611-8528-ddc3b0526245 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:58.063728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be3ce3-973e-4611-8528-ddc3b0526245 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:58.069005 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b12862-fd18-4ea8-a041-a34301137062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:58.069692 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b12862-fd18-4ea8-a041-a34301137062 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.069972 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b12862-fd18-4ea8-a041-a34301137062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.070245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b12862-fd18-4ea8-a041-a34301137062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.070964 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b12862-fd18-4ea8-a041-a34301137062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:58.072550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b12862-fd18-4ea8-a041-a34301137062 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.082377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1341/2665] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:58.086108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc76ae-2e13-4f8d-a402-adbca62087b8 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:58.095964 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc76ae-2e13-4f8d-a402-adbca62087b8 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:58.100582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7836e3-c125-4d31-bc29-e802c98e34bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:58.101444 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7836e3-c125-4d31-bc29-e802c98e34bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.101726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7836e3-c125-4d31-bc29-e802c98e34bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.102004 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7836e3-c125-4d31-bc29-e802c98e34bf admin admin] PATH_INFO: `/v3/projects/b85043d4c61946be90498090a364f054/users/0381d7c8772f4483a0f107b2965f84f6/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.105325 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:58.117184 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7836e3-c125-4d31-bc29-e802c98e34bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85043d4c61946be90498090a364f054, user_id=0381d7c8772f4483a0f107b2965f84f6, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:58.120154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7836e3-c125-4d31-bc29-e802c98e34bf admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.176657 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1325/2666] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:58 2022] PUT /identity/v3/projects/b85043d4c61946be90498090a364f054/users/0381d7c8772f4483a0f107b2965f84f6/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:58.187422 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff7adc-176f-487c-9aa8-c3583204638a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.187711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff7adc-176f-487c-9aa8-c3583204638a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.187989 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff7adc-176f-487c-9aa8-c3583204638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.214735 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-d1ff7adc-176f-487c-9aa8-c3583204638a None None] MFA Rules not processed for user `0381d7c8772f4483a0f107b2965f84f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:58.216057 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-d1ff7adc-176f-487c-9aa8-c3583204638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:58.282464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1342/2667] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:24:58.287045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7836e3-c125-4d31-bc29-e802c98e34bf admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:58.347766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7836e3-c125-4d31-bc29-e802c98e34bf admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:58.352326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecbd26-7f30-47af-b4fc-f9eaed7a2f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:58.352975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecbd26-7f30-47af-b4fc-f9eaed7a2f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.353257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecbd26-7f30-47af-b4fc-f9eaed7a2f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.353531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecbd26-7f30-47af-b4fc-f9eaed7a2f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.354463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecbd26-7f30-47af-b4fc-f9eaed7a2f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:58.356386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecbd26-7f30-47af-b4fc-f9eaed7a2f93 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.434832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1326/2668] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:24:58 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:58.438792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff7adc-176f-487c-9aa8-c3583204638a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:58.450061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff7adc-176f-487c-9aa8-c3583204638a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:58.453662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:58.506753 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55dde-55f0-4f35-aeea-105e99d3b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:58.507498 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55dde-55f0-4f35-aeea-105e99d3b110 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.507747 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55dde-55f0-4f35-aeea-105e99d3b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.508021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55dde-55f0-4f35-aeea-105e99d3b110 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.508791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d55dde-55f0-4f35-aeea-105e99d3b110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:58.510992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d55dde-55f0-4f35-aeea-105e99d3b110 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.607337 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1343/2669] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:24:58 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:24:58.608635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecbd26-7f30-47af-b4fc-f9eaed7a2f93 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:58.619689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecbd26-7f30-47af-b4fc-f9eaed7a2f93 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:58.624414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e4322-07b2-491e-b094-e752c8382d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:58.625489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4322-07b2-491e-b094-e752c8382d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.625489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4322-07b2-491e-b094-e752c8382d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.636164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4322-07b2-491e-b094-e752c8382d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.636164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e4322-07b2-491e-b094-e752c8382d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:58.636164 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e4322-07b2-491e-b094-e752c8382d92 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.639595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1327/2670] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:58.643793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55dde-55f0-4f35-aeea-105e99d3b110 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:58.654086 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55dde-55f0-4f35-aeea-105e99d3b110 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:58.659119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f60c4-e7d8-4f13-80b1-83bd1b02040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:58.660012 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f60c4-e7d8-4f13-80b1-83bd1b02040e admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.660290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f60c4-e7d8-4f13-80b1-83bd1b02040e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.660611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f60c4-e7d8-4f13-80b1-83bd1b02040e admin admin] PATH_INFO: `/v3/projects/0a38951a241f4f41903a4492511fb5a7/users/70134bfb6b1c4b918855fb5b4fd34081/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.676229 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f60c4-e7d8-4f13-80b1-83bd1b02040e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a38951a241f4f41903a4492511fb5a7, user_id=70134bfb6b1c4b918855fb5b4fd34081, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:58.678970 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f60c4-e7d8-4f13-80b1-83bd1b02040e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.782430 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1344/2671] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:58 2022] PUT /identity/v3/projects/0a38951a241f4f41903a4492511fb5a7/users/70134bfb6b1c4b918855fb5b4fd34081/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:58.786650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e4322-07b2-491e-b094-e752c8382d92 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:58.797561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e4322-07b2-491e-b094-e752c8382d92 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:58.853561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4ade-4c45-43d3-8a28-136dd33b853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:58.854470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4ade-4c45-43d3-8a28-136dd33b853a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.854791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4ade-4c45-43d3-8a28-136dd33b853a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.855063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4ade-4c45-43d3-8a28-136dd33b853a admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.855834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4ade-4c45-43d3-8a28-136dd33b853a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:58.857406 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4ade-4c45-43d3-8a28-136dd33b853a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.867315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1328/2672] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:24:58.871395 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f60c4-e7d8-4f13-80b1-83bd1b02040e admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:58.882312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f60c4-e7d8-4f13-80b1-83bd1b02040e admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:58.887028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44891d-5aeb-4220-a89d-57012d317d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:58.887940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44891d-5aeb-4220-a89d-57012d317d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.888333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44891d-5aeb-4220-a89d-57012d317d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.888616 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44891d-5aeb-4220-a89d-57012d317d22 admin admin] PATH_INFO: `/v3/projects/0a38951a241f4f41903a4492511fb5a7/users/70134bfb6b1c4b918855fb5b4fd34081/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.890649 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44891d-5aeb-4220-a89d-57012d317d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a38951a241f4f41903a4492511fb5a7, user_id=70134bfb6b1c4b918855fb5b4fd34081, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:58.893321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44891d-5aeb-4220-a89d-57012d317d22 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:58.903695 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1345/2673] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:24:58 2022] PUT /identity/v3/projects/0a38951a241f4f41903a4492511fb5a7/users/70134bfb6b1c4b918855fb5b4fd34081/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:24:58.913826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb74f98-8cec-4f2f-8c2e-e4cd039e9bca None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:58.914119 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb74f98-8cec-4f2f-8c2e-e4cd039e9bca None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:58.914427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb74f98-8cec-4f2f-8c2e-e4cd039e9bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:58.940930 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-cdb74f98-8cec-4f2f-8c2e-e4cd039e9bca None None] MFA Rules not processed for user `70134bfb6b1c4b918855fb5b4fd34081`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:58.942682 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-cdb74f98-8cec-4f2f-8c2e-e4cd039e9bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:58.985321 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:24:59.008896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1329/2674] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:59.019716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44891d-5aeb-4220-a89d-57012d317d22 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:59.021502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7e44891d-5aeb-4220-a89d-57012d317d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:59.078091 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44891d-5aeb-4220-a89d-57012d317d22 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:59.081824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7601c7-89f9-49c1-a1dd-62a54fbf1126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:59.082462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7601c7-89f9-49c1-a1dd-62a54fbf1126 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:59.082751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7601c7-89f9-49c1-a1dd-62a54fbf1126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:59.083032 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7601c7-89f9-49c1-a1dd-62a54fbf1126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:59.091781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7601c7-89f9-49c1-a1dd-62a54fbf1126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:59.093193 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7601c7-89f9-49c1-a1dd-62a54fbf1126 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:59.102859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1346/2675] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:24:59.130314 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb74f98-8cec-4f2f-8c2e-e4cd039e9bca None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:59.190519 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb74f98-8cec-4f2f-8c2e-e4cd039e9bca None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:59.195198 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:59.196066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:59.196346 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:59.196616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] PATH_INFO: `/v3/users/0381d7c8772f4483a0f107b2965f84f6` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:59.197800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0381d7c8772f4483a0f107b2965f84f6)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:59.199740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:59.400615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0381d7c8772f4483a0f107b2965f84f6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:59.401283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0381d7c8772f4483a0f107b2965f84f6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:59.412929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0381d7c8772f4483a0f107b2965f84f6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:59.419702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0381d7c8772f4483a0f107b2965f84f6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:59.420356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0381d7c8772f4483a0f107b2965f84f6'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:24:59.513030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1330/2676] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:24:59 2022] DELETE /identity/v3/users/0381d7c8772f4483a0f107b2965f84f6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:24:59.517499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cea00-f4d8-4245-b609-32a365455c5c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:59.517793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cea00-f4d8-4245-b609-32a365455c5c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:59.518071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cea00-f4d8-4245-b609-32a365455c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:59.535900 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6c2cea00-f4d8-4245-b609-32a365455c5c None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:24:59.537092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6c2cea00-f4d8-4245-b609-32a365455c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:59.594781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1347/2677] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:24:59.604640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:24:59.606066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:24:59.662347 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff645aef-fec9-4933-8653-6240e57d0507 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:24:59.666118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fa3bd-9f38-4e6e-ae07-f08ec1493832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:24:59.666771 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fa3bd-9f38-4e6e-ae07-f08ec1493832 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:24:59.667056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fa3bd-9f38-4e6e-ae07-f08ec1493832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:24:59.667367 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fa3bd-9f38-4e6e-ae07-f08ec1493832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:24:59.677487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fa3bd-9f38-4e6e-ae07-f08ec1493832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:24:59.678910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fa3bd-9f38-4e6e-ae07-f08ec1493832 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:24:59.688815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1331/2678] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:00.115625 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cea00-f4d8-4245-b609-32a365455c5c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:00.117103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6c2cea00-f4d8-4245-b609-32a365455c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:00.131619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:00.137119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cea00-f4d8-4245-b609-32a365455c5c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:00.145686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:00.145686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:00.145686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:00.145686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] PATH_INFO: `/v3/projects/b85043d4c61946be90498090a364f054` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:00.146386 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85043d4c61946be90498090a364f054)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:00.147338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:00.258884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85043d4c61946be90498090a364f054', 'request_id': 'req-e8801b6d-04f9-44da-8f79-281f0651e8c0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.265510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85043d4c61946be90498090a364f054', 'request_id': 'req-e8801b6d-04f9-44da-8f79-281f0651e8c0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.324571 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85043d4c61946be90498090a364f054', 'request_id': 'req-e8801b6d-04f9-44da-8f79-281f0651e8c0'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.335572 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] The token cache is being invalidate because project b85043d4c61946be90498090a364f054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:25:00.335802 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.336426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.337995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1348/2679] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:25:00 2022] DELETE /identity/v3/projects/b85043d4c61946be90498090a364f054 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:25:00.342080 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fa3bd-9f38-4e6e-ae07-f08ec1493832 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:00.347040 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:00.352327 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fa3bd-9f38-4e6e-ae07-f08ec1493832 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:00.409244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:00.410175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:00.410456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:00.410732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] PATH_INFO: `/v3/users/70134bfb6b1c4b918855fb5b4fd34081` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:00.412448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70134bfb6b1c4b918855fb5b4fd34081)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:00.414344 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:00.606963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70134bfb6b1c4b918855fb5b4fd34081'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.607700 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70134bfb6b1c4b918855fb5b4fd34081'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.620275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70134bfb6b1c4b918855fb5b4fd34081'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.627263 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70134bfb6b1c4b918855fb5b4fd34081'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.627968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-419aebb3-ceee-436f-97c1-49fe9799cf81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70134bfb6b1c4b918855fb5b4fd34081'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:00.724220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1332/2680] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:25:00 2022] DELETE /identity/v3/users/70134bfb6b1c4b918855fb5b4fd34081 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:01.249814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:01.249814 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:01.284024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801b6d-04f9-44da-8f79-281f0651e8c0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:01.346696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:01.347591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:01.347871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:01.348254 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] PATH_INFO: `/v3/projects/0a38951a241f4f41903a4492511fb5a7` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:01.350001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a38951a241f4f41903a4492511fb5a7)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:01.351969 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:01.445234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a38951a241f4f41903a4492511fb5a7', 'request_id': 'req-c4ec9248-3655-405c-8709-9410c0a6bab7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:01.451361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a38951a241f4f41903a4492511fb5a7', 'request_id': 'req-c4ec9248-3655-405c-8709-9410c0a6bab7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:01.512738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a38951a241f4f41903a4492511fb5a7', 'request_id': 'req-c4ec9248-3655-405c-8709-9410c0a6bab7'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:01.523774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] The token cache is being invalidate because project 0a38951a241f4f41903a4492511fb5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:25:01.524060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:01.524679 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c4ec9248-3655-405c-8709-9410c0a6bab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:01.526211 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1349/2681] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:25:01 2022] DELETE /identity/v3/projects/0a38951a241f4f41903a4492511fb5a7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:01.531084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a288cf-5c22-43d4-b0f2-0f57228245ad None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:01.531557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a288cf-5c22-43d4-b0f2-0f57228245ad None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:01.531696 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a288cf-5c22-43d4-b0f2-0f57228245ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:01.550289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c9a288cf-5c22-43d4-b0f2-0f57228245ad None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:01.551563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c9a288cf-5c22-43d4-b0f2-0f57228245ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:01.610206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1333/2682] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:01.618966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ee24-7e98-46f1-8c7b-9282da220541 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:01.619292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ee24-7e98-46f1-8c7b-9282da220541 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:01.619573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ee24-7e98-46f1-8c7b-9282da220541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:01.638852 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f8d7ee24-7e98-46f1-8c7b-9282da220541 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:01.640103 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f8d7ee24-7e98-46f1-8c7b-9282da220541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:01.648538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1350/2683] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:01.652749 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a288cf-5c22-43d4-b0f2-0f57228245ad None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:01.663201 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a288cf-5c22-43d4-b0f2-0f57228245ad None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:01.667626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4beb8b-5d13-40fa-b172-829d401c033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:01.668271 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4beb8b-5d13-40fa-b172-829d401c033e admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:01.668549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4beb8b-5d13-40fa-b172-829d401c033e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:01.668821 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4beb8b-5d13-40fa-b172-829d401c033e admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:01.669652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4beb8b-5d13-40fa-b172-829d401c033e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:25:01.669959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4beb8b-5d13-40fa-b172-829d401c033e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:01.671553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4beb8b-5d13-40fa-b172-829d401c033e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:01.682787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1334/2684] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:25:01.686765 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ee24-7e98-46f1-8c7b-9282da220541 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:01.695991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ee24-7e98-46f1-8c7b-9282da220541 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:01.700641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4a2cc-bb16-4920-bdb5-efa36f1c3485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:01.701282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4a2cc-bb16-4920-bdb5-efa36f1c3485 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:01.701564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4a2cc-bb16-4920-bdb5-efa36f1c3485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:01.701838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4a2cc-bb16-4920-bdb5-efa36f1c3485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:01.702517 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4a2cc-bb16-4920-bdb5-efa36f1c3485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:01.704438 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4a2cc-bb16-4920-bdb5-efa36f1c3485 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:01.709001 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:01.811079 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1351/2685] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:25:01 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:01.815356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4beb8b-5d13-40fa-b172-829d401c033e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:01.825453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4beb8b-5d13-40fa-b172-829d401c033e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:01.830033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:01.881877 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e39ac-0ce2-482a-b1df-f185aabc4040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:01.882571 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e39ac-0ce2-482a-b1df-f185aabc4040 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:01.882850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e39ac-0ce2-482a-b1df-f185aabc4040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:01.883148 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e39ac-0ce2-482a-b1df-f185aabc4040 admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:01.883822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e39ac-0ce2-482a-b1df-f185aabc4040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:01.885707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e39ac-0ce2-482a-b1df-f185aabc4040 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:01.999232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1335/2686] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:25:01 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:02.003264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4a2cc-bb16-4920-bdb5-efa36f1c3485 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.013891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4a2cc-bb16-4920-bdb5-efa36f1c3485 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:02.021733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdb819-c57a-4f32-bc7c-c7adbc56e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:02.022410 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdb819-c57a-4f32-bc7c-c7adbc56e97d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.022696 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdb819-c57a-4f32-bc7c-c7adbc56e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.022974 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdb819-c57a-4f32-bc7c-c7adbc56e97d admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.023731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdb819-c57a-4f32-bc7c-c7adbc56e97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:02.025536 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdb819-c57a-4f32-bc7c-c7adbc56e97d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:02.039574 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1352/2687] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:25:02.044252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e39ac-0ce2-482a-b1df-f185aabc4040 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.056220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e39ac-0ce2-482a-b1df-f185aabc4040 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:02.061173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e6e5-1d24-4d35-84d0-50016e03dc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:02.061924 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e6e5-1d24-4d35-84d0-50016e03dc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.062097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e6e5-1d24-4d35-84d0-50016e03dc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.062398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e6e5-1d24-4d35-84d0-50016e03dc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.063131 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95e6e5-1d24-4d35-84d0-50016e03dc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:02.064718 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95e6e5-1d24-4d35-84d0-50016e03dc60 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:02.076439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1336/2688] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:02.081415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdb819-c57a-4f32-bc7c-c7adbc56e97d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.093148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdb819-c57a-4f32-bc7c-c7adbc56e97d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:02.097988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ace8f-8fc6-4eed-b455-aea30530fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:02.098859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ace8f-8fc6-4eed-b455-aea30530fdf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.099182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ace8f-8fc6-4eed-b455-aea30530fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.105375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ace8f-8fc6-4eed-b455-aea30530fdf7 admin admin] PATH_INFO: `/v3/projects/f53bb45338ac42cca2111276cda7fa09/users/655a006428aa442798014713095ada22/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.114100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ace8f-8fc6-4eed-b455-aea30530fdf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53bb45338ac42cca2111276cda7fa09, user_id=655a006428aa442798014713095ada22, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:02.116751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ace8f-8fc6-4eed-b455-aea30530fdf7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:02.194289 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1353/2689] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:25:02 2022] PUT /identity/v3/projects/f53bb45338ac42cca2111276cda7fa09/users/655a006428aa442798014713095ada22/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:25:02.204455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ee24d-115a-45b7-b093-ed4b7b29f50d None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.204743 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ee24d-115a-45b7-b093-ed4b7b29f50d None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.205020 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ee24d-115a-45b7-b093-ed4b7b29f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.233169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-604ee24d-115a-45b7-b093-ed4b7b29f50d None None] MFA Rules not processed for user `655a006428aa442798014713095ada22`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:02.234360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-604ee24d-115a-45b7-b093-ed4b7b29f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:02.298523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1337/2690] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:25:02.303569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ace8f-8fc6-4eed-b455-aea30530fdf7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.364297 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ace8f-8fc6-4eed-b455-aea30530fdf7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:02.369465 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121462a4-7303-4701-94c7-19392afdce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:02.370115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121462a4-7303-4701-94c7-19392afdce8f admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.370399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121462a4-7303-4701-94c7-19392afdce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.370675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121462a4-7303-4701-94c7-19392afdce8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.371407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121462a4-7303-4701-94c7-19392afdce8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:02.373281 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121462a4-7303-4701-94c7-19392afdce8f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:02.455322 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1354/2691] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:25:02 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:02.456493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ee24d-115a-45b7-b093-ed4b7b29f50d None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.468420 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ee24d-115a-45b7-b093-ed4b7b29f50d None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:02.528395 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762a4d5-d719-4957-b49c-c9412d343abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:02.529452 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762a4d5-d719-4957-b49c-c9412d343abb admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.529667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762a4d5-d719-4957-b49c-c9412d343abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.530116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762a4d5-d719-4957-b49c-c9412d343abb admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.530626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762a4d5-d719-4957-b49c-c9412d343abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:02.532567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762a4d5-d719-4957-b49c-c9412d343abb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:02.607974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1338/2692] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:25:02 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:02.609314 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121462a4-7303-4701-94c7-19392afdce8f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.620424 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121462a4-7303-4701-94c7-19392afdce8f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:02.625123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d775fb9-4824-442f-a7fe-0a0b68704e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:02.625795 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d775fb9-4824-442f-a7fe-0a0b68704e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.626065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d775fb9-4824-442f-a7fe-0a0b68704e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.626339 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d775fb9-4824-442f-a7fe-0a0b68704e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.627060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d775fb9-4824-442f-a7fe-0a0b68704e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:02.628661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d775fb9-4824-442f-a7fe-0a0b68704e50 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:02.640040 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1355/2693] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:02.648349 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762a4d5-d719-4957-b49c-c9412d343abb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.654832 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762a4d5-d719-4957-b49c-c9412d343abb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:02.659426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7bad3-47b8-4a1a-9602-e69d9bd127eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:02.660322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7bad3-47b8-4a1a-9602-e69d9bd127eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.660605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7bad3-47b8-4a1a-9602-e69d9bd127eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.660883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7bad3-47b8-4a1a-9602-e69d9bd127eb admin admin] PATH_INFO: `/v3/projects/b805a412e17e466fbd46991c3686a94e/users/74b0d23e28ab42c4af5ab14dba8de463/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.663742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:02.676619 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7bad3-47b8-4a1a-9602-e69d9bd127eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b805a412e17e466fbd46991c3686a94e, user_id=74b0d23e28ab42c4af5ab14dba8de463, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:02.679319 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7bad3-47b8-4a1a-9602-e69d9bd127eb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:02.753229 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1339/2694] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:25:02 2022] PUT /identity/v3/projects/b805a412e17e466fbd46991c3686a94e/users/74b0d23e28ab42c4af5ab14dba8de463/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:02.757898 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d775fb9-4824-442f-a7fe-0a0b68704e50 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.767790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d775fb9-4824-442f-a7fe-0a0b68704e50 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:02.823139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb69749-a63a-4275-9e44-83330d0245ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:02.823806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb69749-a63a-4275-9e44-83330d0245ec admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.824088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb69749-a63a-4275-9e44-83330d0245ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.824385 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb69749-a63a-4275-9e44-83330d0245ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.825100 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb69749-a63a-4275-9e44-83330d0245ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:02.826668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb69749-a63a-4275-9e44-83330d0245ec admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:02.837299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1356/2695] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:25:02.841491 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7bad3-47b8-4a1a-9602-e69d9bd127eb admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.851791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7bad3-47b8-4a1a-9602-e69d9bd127eb admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:02.856602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd82d3-4d20-4e55-a333-361e58863524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:02.857465 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd82d3-4d20-4e55-a333-361e58863524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.857748 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd82d3-4d20-4e55-a333-361e58863524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.858023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd82d3-4d20-4e55-a333-361e58863524 admin admin] PATH_INFO: `/v3/projects/b805a412e17e466fbd46991c3686a94e/users/74b0d23e28ab42c4af5ab14dba8de463/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.860174 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd82d3-4d20-4e55-a333-361e58863524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b805a412e17e466fbd46991c3686a94e, user_id=74b0d23e28ab42c4af5ab14dba8de463, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:02.862834 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd82d3-4d20-4e55-a333-361e58863524 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:02.873241 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1340/2696] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:25:02 2022] PUT /identity/v3/projects/b805a412e17e466fbd46991c3686a94e/users/74b0d23e28ab42c4af5ab14dba8de463/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:02.883785 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd219b-f34f-4a13-bfeb-9b16625b1447 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:02.884073 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd219b-f34f-4a13-bfeb-9b16625b1447 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:02.884351 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd219b-f34f-4a13-bfeb-9b16625b1447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:02.910344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-defd219b-f34f-4a13-bfeb-9b16625b1447 None None] MFA Rules not processed for user `74b0d23e28ab42c4af5ab14dba8de463`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:02.911702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-defd219b-f34f-4a13-bfeb-9b16625b1447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:02.920808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:02.979368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1357/2697] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:02.990955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd82d3-4d20-4e55-a333-361e58863524 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:02.992869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ebdd82d3-4d20-4e55-a333-361e58863524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:03.049845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd82d3-4d20-4e55-a333-361e58863524 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:03.054097 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed1443-db63-4865-9b01-80a0830b372c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:03.054739 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1443-db63-4865-9b01-80a0830b372c service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:03.055024 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1443-db63-4865-9b01-80a0830b372c service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:03.055331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1443-db63-4865-9b01-80a0830b372c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:03.064423 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed1443-db63-4865-9b01-80a0830b372c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:03.065879 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed1443-db63-4865-9b01-80a0830b372c service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:03.075972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1341/2698] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:03.138237 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd219b-f34f-4a13-bfeb-9b16625b1447 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:03.199329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd219b-f34f-4a13-bfeb-9b16625b1447 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:03.203845 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:03.204711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:03.204988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:03.205258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] PATH_INFO: `/v3/users/655a006428aa442798014713095ada22` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:03.206488 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=655a006428aa442798014713095ada22)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:03.208368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:03.418128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655a006428aa442798014713095ada22'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:03.418790 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655a006428aa442798014713095ada22'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:03.419401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655a006428aa442798014713095ada22'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:03.431791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655a006428aa442798014713095ada22'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:03.438615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655a006428aa442798014713095ada22'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:03.506705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1358/2699] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:25:03 2022] DELETE /identity/v3/users/655a006428aa442798014713095ada22 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:03.511199 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff9903-f5b8-4e27-abeb-7ce8989b84fb None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:03.511492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff9903-f5b8-4e27-abeb-7ce8989b84fb None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:03.511769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff9903-f5b8-4e27-abeb-7ce8989b84fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:03.529322 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-75ff9903-f5b8-4e27-abeb-7ce8989b84fb None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:03.530493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-75ff9903-f5b8-4e27-abeb-7ce8989b84fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:03.589796 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1342/2700] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:03.600274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:03.601691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:03.634453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:03.659822 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb32c8-a9ad-425c-b626-c8f53533da31 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:03.664318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ef7ce-efdc-4413-bfae-a9f751bd5df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:03.664993 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ef7ce-efdc-4413-bfae-a9f751bd5df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:03.665307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ef7ce-efdc-4413-bfae-a9f751bd5df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:03.665586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ef7ce-efdc-4413-bfae-a9f751bd5df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:03.674740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ef7ce-efdc-4413-bfae-a9f751bd5df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:03.676205 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ef7ce-efdc-4413-bfae-a9f751bd5df4 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:03.686548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1359/2701] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:25:04.103699 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff9903-f5b8-4e27-abeb-7ce8989b84fb None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:04.105359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-75ff9903-f5b8-4e27-abeb-7ce8989b84fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:04.117895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff9903-f5b8-4e27-abeb-7ce8989b84fb None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:04.122675 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:04.123450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:04.123757 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:04.124030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] PATH_INFO: `/v3/projects/f53bb45338ac42cca2111276cda7fa09` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:04.125219 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53bb45338ac42cca2111276cda7fa09)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:04.127247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:04.222220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53bb45338ac42cca2111276cda7fa09', 'request_id': 'req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.228851 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53bb45338ac42cca2111276cda7fa09', 'request_id': 'req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.307455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53bb45338ac42cca2111276cda7fa09', 'request_id': 'req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.312902 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:04.319819 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] The token cache is being invalidate because project f53bb45338ac42cca2111276cda7fa09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:25:04.320108 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.320732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.322305 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1343/2702] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:25:04 2022] DELETE /identity/v3/projects/f53bb45338ac42cca2111276cda7fa09 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:04.326313 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ef7ce-efdc-4413-bfae-a9f751bd5df4 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:04.336816 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ef7ce-efdc-4413-bfae-a9f751bd5df4 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:04.391776 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:04.392684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:04.392962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:04.393238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] PATH_INFO: `/v3/users/74b0d23e28ab42c4af5ab14dba8de463` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:04.394419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b0d23e28ab42c4af5ab14dba8de463)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:04.396997 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:04.531863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b0d23e28ab42c4af5ab14dba8de463'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.532607 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b0d23e28ab42c4af5ab14dba8de463'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.533216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b0d23e28ab42c4af5ab14dba8de463'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.545578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b0d23e28ab42c4af5ab14dba8de463'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.552960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a73cb2a7-9f71-4df8-b03a-ad042077105e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b0d23e28ab42c4af5ab14dba8de463'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:04.638262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1360/2703] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:25:04 2022] DELETE /identity/v3/users/74b0d23e28ab42c4af5ab14dba8de463 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:05.022967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:05.024608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:05.039059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a148b54-2dfe-4f3b-9b0f-e47e763d55d0 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:05.095586 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:05.096472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.096753 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.097023 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] PATH_INFO: `/v3/projects/b805a412e17e466fbd46991c3686a94e` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.098193 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b805a412e17e466fbd46991c3686a94e)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:05.100600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:05.190495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b805a412e17e466fbd46991c3686a94e', 'request_id': 'req-3ef928a0-2c41-4afb-b659-5661e5c1deb2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:05.196729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b805a412e17e466fbd46991c3686a94e', 'request_id': 'req-3ef928a0-2c41-4afb-b659-5661e5c1deb2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:05.261710 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b805a412e17e466fbd46991c3686a94e', 'request_id': 'req-3ef928a0-2c41-4afb-b659-5661e5c1deb2'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:05.274691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] The token cache is being invalidate because project b805a412e17e466fbd46991c3686a94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:25:05.274990 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:05.275707 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3ef928a0-2c41-4afb-b659-5661e5c1deb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:05.277284 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1344/2704] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:25:05 2022] DELETE /identity/v3/projects/b805a412e17e466fbd46991c3686a94e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:05.282290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37734508-0e97-446c-b0b1-078f3ea7190a None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.282446 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37734508-0e97-446c-b0b1-078f3ea7190a None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.282705 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37734508-0e97-446c-b0b1-078f3ea7190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.300217 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-37734508-0e97-446c-b0b1-078f3ea7190a None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:05.301396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-37734508-0e97-446c-b0b1-078f3ea7190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:05.344855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:05.359598 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1361/2705] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:05.368935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909daf8-960b-4e7c-8146-4a96204fc0f6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.369225 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909daf8-960b-4e7c-8146-4a96204fc0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.369554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909daf8-960b-4e7c-8146-4a96204fc0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.388411 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c909daf8-960b-4e7c-8146-4a96204fc0f6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:05.389605 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c909daf8-960b-4e7c-8146-4a96204fc0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:05.397442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1345/2706] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:05.401720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37734508-0e97-446c-b0b1-078f3ea7190a None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:05.411609 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37734508-0e97-446c-b0b1-078f3ea7190a None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:05.416586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801de5a-88ea-412c-b9b9-2a8500483208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:05.418711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801de5a-88ea-412c-b9b9-2a8500483208 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.418711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801de5a-88ea-412c-b9b9-2a8500483208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.418711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801de5a-88ea-412c-b9b9-2a8500483208 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.418711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801de5a-88ea-412c-b9b9-2a8500483208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:25:05.419115 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801de5a-88ea-412c-b9b9-2a8500483208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:05.420389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801de5a-88ea-412c-b9b9-2a8500483208 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:05.432251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1362/2707] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:25:05.436349 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909daf8-960b-4e7c-8146-4a96204fc0f6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:05.446209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909daf8-960b-4e7c-8146-4a96204fc0f6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:05.450931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee7e1-9433-4e48-b716-fa2cf3b7fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:05.451607 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee7e1-9433-4e48-b716-fa2cf3b7fd0c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.451888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee7e1-9433-4e48-b716-fa2cf3b7fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.452162 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee7e1-9433-4e48-b716-fa2cf3b7fd0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.452849 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee7e1-9433-4e48-b716-fa2cf3b7fd0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:05.454760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee7e1-9433-4e48-b716-fa2cf3b7fd0c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:05.547766 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1346/2708] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:25:05 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:05.551914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801de5a-88ea-412c-b9b9-2a8500483208 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:05.561956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801de5a-88ea-412c-b9b9-2a8500483208 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:05.617082 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30932622-47d6-445c-a1e0-f005b17ca2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:05.617740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30932622-47d6-445c-a1e0-f005b17ca2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.618018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30932622-47d6-445c-a1e0-f005b17ca2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.618285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30932622-47d6-445c-a1e0-f005b17ca2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.618952 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30932622-47d6-445c-a1e0-f005b17ca2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:05.620868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30932622-47d6-445c-a1e0-f005b17ca2d4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:05.708130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1363/2709] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:25:05 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:05.712685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee7e1-9433-4e48-b716-fa2cf3b7fd0c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:05.723342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee7e1-9433-4e48-b716-fa2cf3b7fd0c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:05.728196 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d06536-1cb0-4472-b54c-76cab259c297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:05.728850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d06536-1cb0-4472-b54c-76cab259c297 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.729387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d06536-1cb0-4472-b54c-76cab259c297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.729661 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d06536-1cb0-4472-b54c-76cab259c297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.730379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d06536-1cb0-4472-b54c-76cab259c297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:05.731996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d06536-1cb0-4472-b54c-76cab259c297 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:05.742481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1347/2710] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:05.746242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30932622-47d6-445c-a1e0-f005b17ca2d4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:05.756476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30932622-47d6-445c-a1e0-f005b17ca2d4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:05.760981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fad94-f51c-40a5-ba76-90dbaafb717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:05.761628 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fad94-f51c-40a5-ba76-90dbaafb717a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.761905 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fad94-f51c-40a5-ba76-90dbaafb717a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.762179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fad94-f51c-40a5-ba76-90dbaafb717a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.762890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fad94-f51c-40a5-ba76-90dbaafb717a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:05.764659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fad94-f51c-40a5-ba76-90dbaafb717a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:05.774942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1364/2711] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:05.778862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d06536-1cb0-4472-b54c-76cab259c297 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:05.788702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d06536-1cb0-4472-b54c-76cab259c297 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:05.793233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389dbcd-77f6-4d00-a49a-646b536a67dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:05.794086 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389dbcd-77f6-4d00-a49a-646b536a67dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.794364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389dbcd-77f6-4d00-a49a-646b536a67dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.794634 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389dbcd-77f6-4d00-a49a-646b536a67dd admin admin] PATH_INFO: `/v3/projects/f15b34c2121441e696ebf6d517be540b/users/678c6e831efd4ac68e033024452ef434/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.809522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389dbcd-77f6-4d00-a49a-646b536a67dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15b34c2121441e696ebf6d517be540b, user_id=678c6e831efd4ac68e033024452ef434, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:05.812182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389dbcd-77f6-4d00-a49a-646b536a67dd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:05.878777 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1348/2712] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:25:05 2022] PUT /identity/v3/projects/f15b34c2121441e696ebf6d517be540b/users/678c6e831efd4ac68e033024452ef434/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:05.889521 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ac42f-3a2c-4617-973a-d4c00cfecd9c None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:05.889831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ac42f-3a2c-4617-973a-d4c00cfecd9c None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:05.890104 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ac42f-3a2c-4617-973a-d4c00cfecd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:05.925719 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-768ac42f-3a2c-4617-973a-d4c00cfecd9c None None] MFA Rules not processed for user `678c6e831efd4ac68e033024452ef434`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:05.926914 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-768ac42f-3a2c-4617-973a-d4c00cfecd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:05.988691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1365/2713] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:05.993006 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389dbcd-77f6-4d00-a49a-646b536a67dd admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:06.018557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:06.096072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389dbcd-77f6-4d00-a49a-646b536a67dd admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:06.100862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c5ab2-239c-488e-827a-dc7cf36aa6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:06.101509 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c5ab2-239c-488e-827a-dc7cf36aa6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:06.101792 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c5ab2-239c-488e-827a-dc7cf36aa6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:06.102066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c5ab2-239c-488e-827a-dc7cf36aa6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:06.102870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c5ab2-239c-488e-827a-dc7cf36aa6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:06.105251 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c5ab2-239c-488e-827a-dc7cf36aa6b6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:06.171472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1349/2714] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:25:05 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:06.175454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ac42f-3a2c-4617-973a-d4c00cfecd9c None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:06.203792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ac42f-3a2c-4617-973a-d4c00cfecd9c None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:06.207285 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:06.261940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce2747-f4b0-4c9f-9362-cf20417712e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:06.262539 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce2747-f4b0-4c9f-9362-cf20417712e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:06.262821 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce2747-f4b0-4c9f-9362-cf20417712e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:06.263114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce2747-f4b0-4c9f-9362-cf20417712e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:06.263922 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce2747-f4b0-4c9f-9362-cf20417712e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:06.265823 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce2747-f4b0-4c9f-9362-cf20417712e8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:06.324855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1366/2715] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:25:06 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:06.328830 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c5ab2-239c-488e-827a-dc7cf36aa6b6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:06.339143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c5ab2-239c-488e-827a-dc7cf36aa6b6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:06.343681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055013c0-ffaf-43f9-90f8-981f4cdaa512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:06.344332 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055013c0-ffaf-43f9-90f8-981f4cdaa512 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:06.344615 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055013c0-ffaf-43f9-90f8-981f4cdaa512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:06.344889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055013c0-ffaf-43f9-90f8-981f4cdaa512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:06.345602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055013c0-ffaf-43f9-90f8-981f4cdaa512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:06.347210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055013c0-ffaf-43f9-90f8-981f4cdaa512 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:06.357204 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1350/2716] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:06.361096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce2747-f4b0-4c9f-9362-cf20417712e8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:06.371454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce2747-f4b0-4c9f-9362-cf20417712e8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:06.375976 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2950b27-3ea9-4cfc-877b-0a0d001997e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:06.376851 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2950b27-3ea9-4cfc-877b-0a0d001997e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:06.377132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2950b27-3ea9-4cfc-877b-0a0d001997e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:06.377406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2950b27-3ea9-4cfc-877b-0a0d001997e0 admin admin] PATH_INFO: `/v3/projects/e82bcece55e44d46994a08fba8984e56/users/7a50107abe0043bf85b9aa9516c0f03d/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:06.392496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2950b27-3ea9-4cfc-877b-0a0d001997e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82bcece55e44d46994a08fba8984e56, user_id=7a50107abe0043bf85b9aa9516c0f03d, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:06.395149 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2950b27-3ea9-4cfc-877b-0a0d001997e0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:06.454172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1367/2717] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:25:06 2022] PUT /identity/v3/projects/e82bcece55e44d46994a08fba8984e56/users/7a50107abe0043bf85b9aa9516c0f03d/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:06.458112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055013c0-ffaf-43f9-90f8-981f4cdaa512 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:06.468175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055013c0-ffaf-43f9-90f8-981f4cdaa512 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:06.522968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2d736-ae9d-4a80-973d-7dbc87517dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:06.523585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2d736-ae9d-4a80-973d-7dbc87517dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:06.523873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2d736-ae9d-4a80-973d-7dbc87517dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:06.524145 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2d736-ae9d-4a80-973d-7dbc87517dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:06.524855 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2d736-ae9d-4a80-973d-7dbc87517dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:06.526430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2d736-ae9d-4a80-973d-7dbc87517dc1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:06.535910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1351/2718] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:06.540390 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2950b27-3ea9-4cfc-877b-0a0d001997e0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:06.550602 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2950b27-3ea9-4cfc-877b-0a0d001997e0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:06.555709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9be3f-4ed5-4482-ba3e-8aed48c86471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:06.556578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9be3f-4ed5-4482-ba3e-8aed48c86471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:06.556856 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9be3f-4ed5-4482-ba3e-8aed48c86471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:06.557123 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9be3f-4ed5-4482-ba3e-8aed48c86471 admin admin] PATH_INFO: `/v3/projects/e82bcece55e44d46994a08fba8984e56/users/7a50107abe0043bf85b9aa9516c0f03d/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:06.559062 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9be3f-4ed5-4482-ba3e-8aed48c86471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82bcece55e44d46994a08fba8984e56, user_id=7a50107abe0043bf85b9aa9516c0f03d, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:06.561731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9be3f-4ed5-4482-ba3e-8aed48c86471 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:06.571870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1368/2719] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:25:06 2022] PUT /identity/v3/projects/e82bcece55e44d46994a08fba8984e56/users/7a50107abe0043bf85b9aa9516c0f03d/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:06.581802 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a420a24-5266-4657-a323-38ff0c2fbe12 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:06.582092 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a420a24-5266-4657-a323-38ff0c2fbe12 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:06.582394 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a420a24-5266-4657-a323-38ff0c2fbe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:06.608913 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-1a420a24-5266-4657-a323-38ff0c2fbe12 None None] MFA Rules not processed for user `7a50107abe0043bf85b9aa9516c0f03d`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:06.610130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1a420a24-5266-4657-a323-38ff0c2fbe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:06.650480 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:06.677641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1352/2720] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:06.689378 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9be3f-4ed5-4482-ba3e-8aed48c86471 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:06.691028 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-97f9be3f-4ed5-4482-ba3e-8aed48c86471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:06.747664 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9be3f-4ed5-4482-ba3e-8aed48c86471 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:06.751413 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a00f6-8021-4967-a136-d2870794e847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:06.752162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a00f6-8021-4967-a136-d2870794e847 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:06.752513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a00f6-8021-4967-a136-d2870794e847 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:06.752789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a00f6-8021-4967-a136-d2870794e847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:06.762943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a00f6-8021-4967-a136-d2870794e847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:06.764634 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a00f6-8021-4967-a136-d2870794e847 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:06.774855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1369/2721] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:07.837291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a420a24-5266-4657-a323-38ff0c2fbe12 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:07.846576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a420a24-5266-4657-a323-38ff0c2fbe12 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:07.851414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a09444-aff7-41a9-8857-b4f63dda8453 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a50107abe0043bf85b9aa9516c0f03d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e82bcece55e44d46994a08fba8984e56', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:07.851942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a09444-aff7-41a9-8857-b4f63dda8453 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:07.852232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a09444-aff7-41a9-8857-b4f63dda8453 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:07.852514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a09444-aff7-41a9-8857-b4f63dda8453 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:07.853283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a09444-aff7-41a9-8857-b4f63dda8453 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:25:07.853597 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a09444-aff7-41a9-8857-b4f63dda8453 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:07.855482 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a09444-aff7-41a9-8857-b4f63dda8453 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:07.870969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1353/2722] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:25:07.872327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a00f6-8021-4967-a136-d2870794e847 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:07.881935 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a00f6-8021-4967-a136-d2870794e847 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:07.886436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf76d33-a0f4-4720-a18a-67bd934238d5 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a50107abe0043bf85b9aa9516c0f03d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e82bcece55e44d46994a08fba8984e56', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:07.887072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf76d33-a0f4-4720-a18a-67bd934238d5 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:07.887402 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf76d33-a0f4-4720-a18a-67bd934238d5 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:07.887657 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf76d33-a0f4-4720-a18a-67bd934238d5 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:07.888342 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf76d33-a0f4-4720-a18a-67bd934238d5 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:07.890199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf76d33-a0f4-4720-a18a-67bd934238d5 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:07.988978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1370/2723] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:25:07 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:07.993738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a09444-aff7-41a9-8857-b4f63dda8453 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:08.004044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a09444-aff7-41a9-8857-b4f63dda8453 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:08.061575 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a50107abe0043bf85b9aa9516c0f03d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e82bcece55e44d46994a08fba8984e56', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:08.062238 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:08.062531 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:08.062807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:08.063635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:25:08.063972 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:08.065580 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:08.077004 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1354/2724] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:25:08.112811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf76d33-a0f4-4720-a18a-67bd934238d5 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:08.123392 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf76d33-a0f4-4720-a18a-67bd934238d5 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:08.127887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a50107abe0043bf85b9aa9516c0f03d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e82bcece55e44d46994a08fba8984e56', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:08.128731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:08.129037 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:08.129305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] PATH_INFO: `/v3/projects/10d07c8c74574ecd90dd8893061d4aa3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:08.130460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10d07c8c74574ecd90dd8893061d4aa3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:08.132373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:08.217933 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:08.227850 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d07c8c74574ecd90dd8893061d4aa3', 'request_id': 'req-359c9a1e-2d9e-4013-b4c6-b77cee572d13'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:08.234150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d07c8c74574ecd90dd8893061d4aa3', 'request_id': 'req-359c9a1e-2d9e-4013-b4c6-b77cee572d13'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:08.313085 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d07c8c74574ecd90dd8893061d4aa3', 'request_id': 'req-359c9a1e-2d9e-4013-b4c6-b77cee572d13'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:08.324125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] The token cache is being invalidate because project 10d07c8c74574ecd90dd8893061d4aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:25:08.324444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:08.325114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-359c9a1e-2d9e-4013-b4c6-b77cee572d13 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:08.326669 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1371/2725] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:25:08 2022] DELETE /identity/v3/projects/10d07c8c74574ecd90dd8893061d4aa3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:08.910804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:08.912604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:08.976667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42be0a-209f-49a1-ba14-29af203dd248 tempest-VolumeQuotaClassesTest-27596561 tempest-VolumeQuotaClassesTest-27596561-project-admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:09.030992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:09.031910 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:09.032189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:09.032461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] PATH_INFO: `/v3/users/678c6e831efd4ac68e033024452ef434` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:09.033635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=678c6e831efd4ac68e033024452ef434)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:09.035573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:09.040730 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:09.177308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678c6e831efd4ac68e033024452ef434'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:09.177942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678c6e831efd4ac68e033024452ef434'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:09.190333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678c6e831efd4ac68e033024452ef434'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:09.197989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678c6e831efd4ac68e033024452ef434'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:09.198633 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678c6e831efd4ac68e033024452ef434'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:09.255841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1355/2726] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:25:08 2022] DELETE /identity/v3/users/678c6e831efd4ac68e033024452ef434 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:09.263053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbf6ea-f087-4df9-a4b5-03c1e3c3da3b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:09.263053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbf6ea-f087-4df9-a4b5-03c1e3c3da3b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:09.263053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbf6ea-f087-4df9-a4b5-03c1e3c3da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:09.289296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-bcbbf6ea-f087-4df9-a4b5-03c1e3c3da3b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:09.290479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bcbbf6ea-f087-4df9-a4b5-03c1e3c3da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:09.347874 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1372/2727] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:09.358415 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:09.359813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:09.432168 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063515c1-58cf-4cbe-b94f-c154f70630b1 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:09.435816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8039-13b5-4e33-afee-f5b823f2a347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:09.436451 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8039-13b5-4e33-afee-f5b823f2a347 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:09.436732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8039-13b5-4e33-afee-f5b823f2a347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:09.437007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8039-13b5-4e33-afee-f5b823f2a347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:09.446048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab8039-13b5-4e33-afee-f5b823f2a347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:09.447526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab8039-13b5-4e33-afee-f5b823f2a347 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:09.456791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1356/2728] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:09.851857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbf6ea-f087-4df9-a4b5-03c1e3c3da3b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:09.854658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bcbbf6ea-f087-4df9-a4b5-03c1e3c3da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:09.867825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbf6ea-f087-4df9-a4b5-03c1e3c3da3b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:09.872889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:09.873960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:09.874346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:09.874706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] PATH_INFO: `/v3/projects/f15b34c2121441e696ebf6d517be540b` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:09.876547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15b34c2121441e696ebf6d517be540b)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:09.879245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:10.008673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15b34c2121441e696ebf6d517be540b', 'request_id': 'req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.014837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15b34c2121441e696ebf6d517be540b', 'request_id': 'req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.084358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15b34c2121441e696ebf6d517be540b', 'request_id': 'req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.095504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] The token cache is being invalidate because project f15b34c2121441e696ebf6d517be540b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:25:10.095859 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.096397 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.098070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1373/2729] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:25:09 2022] DELETE /identity/v3/projects/f15b34c2121441e696ebf6d517be540b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:10.102004 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8039-13b5-4e33-afee-f5b823f2a347 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:10.111741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8039-13b5-4e33-afee-f5b823f2a347 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:10.167228 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:10.168101 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:10.168380 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:10.168652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] PATH_INFO: `/v3/users/7a50107abe0043bf85b9aa9516c0f03d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:10.169968 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a50107abe0043bf85b9aa9516c0f03d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:10.171950 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:10.185545 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:10.361252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a50107abe0043bf85b9aa9516c0f03d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.361831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a50107abe0043bf85b9aa9516c0f03d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.373610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a50107abe0043bf85b9aa9516c0f03d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.380401 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a50107abe0043bf85b9aa9516c0f03d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.381033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-88e2e064-ba53-458e-b4f2-c3192b03024a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a50107abe0043bf85b9aa9516c0f03d'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:10.449122 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1357/2730] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:25:10 2022] DELETE /identity/v3/users/7a50107abe0043bf85b9aa9516c0f03d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:10.886434 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:10.891154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:10.913631 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5c49d-9bb7-48f5-a3c6-23d3a1c78775 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:10.958497 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:10.976615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:10.978082 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:10.978363 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:10.978637 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] PATH_INFO: `/v3/projects/e82bcece55e44d46994a08fba8984e56` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:10.980181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82bcece55e44d46994a08fba8984e56)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:10.982101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:11.107787 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82bcece55e44d46994a08fba8984e56', 'request_id': 'req-a5e303b4-6814-4f23-97d1-de618c9683d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:11.114013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82bcece55e44d46994a08fba8984e56', 'request_id': 'req-a5e303b4-6814-4f23-97d1-de618c9683d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:11.215809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82bcece55e44d46994a08fba8984e56', 'request_id': 'req-a5e303b4-6814-4f23-97d1-de618c9683d4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:11.226401 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] The token cache is being invalidate because project e82bcece55e44d46994a08fba8984e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:25:11.226687 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:11.231331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-a5e303b4-6814-4f23-97d1-de618c9683d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:11.231331 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1374/2731] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:25:10 2022] DELETE /identity/v3/projects/e82bcece55e44d46994a08fba8984e56 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:11.234602 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518aea6-815c-4ba0-98d1-bd54b6dbfe12 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:11.235067 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518aea6-815c-4ba0-98d1-bd54b6dbfe12 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:11.235189 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518aea6-815c-4ba0-98d1-bd54b6dbfe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:11.273646 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0518aea6-815c-4ba0-98d1-bd54b6dbfe12 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:11.275590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0518aea6-815c-4ba0-98d1-bd54b6dbfe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:11.334042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1358/2732] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:11.342372 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe68b9-c9a8-49fe-9d76-60dfe58a68cc None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:11.342662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe68b9-c9a8-49fe-9d76-60dfe58a68cc None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:11.342942 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe68b9-c9a8-49fe-9d76-60dfe58a68cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:11.362088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cfbe68b9-c9a8-49fe-9d76-60dfe58a68cc None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:11.363292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cfbe68b9-c9a8-49fe-9d76-60dfe58a68cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:11.371305 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1375/2733] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:25:11.375341 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518aea6-815c-4ba0-98d1-bd54b6dbfe12 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:11.384923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518aea6-815c-4ba0-98d1-bd54b6dbfe12 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:11.389354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372dc8-a009-404e-a9f6-6cf638b85622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:11.389992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372dc8-a009-404e-a9f6-6cf638b85622 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:11.390269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372dc8-a009-404e-a9f6-6cf638b85622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:11.390539 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9372dc8-a009-404e-a9f6-6cf638b85622 admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:11.391281 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9372dc8-a009-404e-a9f6-6cf638b85622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:25:11.391610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9372dc8-a009-404e-a9f6-6cf638b85622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:11.393173 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9372dc8-a009-404e-a9f6-6cf638b85622 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:11.404936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1359/2734] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:25:11.409045 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe68b9-c9a8-49fe-9d76-60dfe58a68cc None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:11.418798 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe68b9-c9a8-49fe-9d76-60dfe58a68cc None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:11.423475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02cca-75d8-4f8e-9ab1-f80a3b29d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:11.424113 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02cca-75d8-4f8e-9ab1-f80a3b29d507 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:11.424399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02cca-75d8-4f8e-9ab1-f80a3b29d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:11.424677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02cca-75d8-4f8e-9ab1-f80a3b29d507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:11.425355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a02cca-75d8-4f8e-9ab1-f80a3b29d507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:11.427255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a02cca-75d8-4f8e-9ab1-f80a3b29d507 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:11.502418 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1376/2735] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:25:11 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:11.506375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372dc8-a009-404e-a9f6-6cf638b85622 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:11.516269 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9372dc8-a009-404e-a9f6-6cf638b85622 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:11.572626 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f86a9-f43b-436a-8f7d-6d1788f5674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:11.573289 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f86a9-f43b-436a-8f7d-6d1788f5674c admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:11.573573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f86a9-f43b-436a-8f7d-6d1788f5674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:11.573845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f86a9-f43b-436a-8f7d-6d1788f5674c admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:11.574513 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f86a9-f43b-436a-8f7d-6d1788f5674c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:11.576469 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f86a9-f43b-436a-8f7d-6d1788f5674c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:11.584855 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:11.672783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1360/2736] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:25:11 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:11.676873 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02cca-75d8-4f8e-9ab1-f80a3b29d507 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:11.687313 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02cca-75d8-4f8e-9ab1-f80a3b29d507 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:11.691962 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bf107-d354-4b59-ba4b-9d6f97c14b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:11.692614 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bf107-d354-4b59-ba4b-9d6f97c14b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:11.692896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bf107-d354-4b59-ba4b-9d6f97c14b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:11.693169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bf107-d354-4b59-ba4b-9d6f97c14b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:11.693889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bf107-d354-4b59-ba4b-9d6f97c14b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:11.695548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bf107-d354-4b59-ba4b-9d6f97c14b30 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:11.706523 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1377/2737] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:11.710387 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f86a9-f43b-436a-8f7d-6d1788f5674c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:11.721226 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f86a9-f43b-436a-8f7d-6d1788f5674c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:11.725843 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae36b9-60ba-4003-b0c2-5844343aa8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:11.726489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae36b9-60ba-4003-b0c2-5844343aa8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:11.726772 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae36b9-60ba-4003-b0c2-5844343aa8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:11.727049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae36b9-60ba-4003-b0c2-5844343aa8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:11.727803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae36b9-60ba-4003-b0c2-5844343aa8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:11.729687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae36b9-60ba-4003-b0c2-5844343aa8f6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:11.740039 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1361/2738] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:11.743887 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bf107-d354-4b59-ba4b-9d6f97c14b30 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:11.753608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bf107-d354-4b59-ba4b-9d6f97c14b30 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:11.758286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440d1dd-e501-436c-9594-d8ca4cb6b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:11.759183 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440d1dd-e501-436c-9594-d8ca4cb6b16b admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:11.759987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440d1dd-e501-436c-9594-d8ca4cb6b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:11.760261 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440d1dd-e501-436c-9594-d8ca4cb6b16b admin admin] PATH_INFO: `/v3/projects/d7afabbe358c445b87cf8e2a584a37e9/users/998821b3dbeb47ecbd58aba96168874c/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:11.774508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440d1dd-e501-436c-9594-d8ca4cb6b16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7afabbe358c445b87cf8e2a584a37e9, user_id=998821b3dbeb47ecbd58aba96168874c, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:11.777781 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440d1dd-e501-436c-9594-d8ca4cb6b16b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:11.827350 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1378/2739] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:25:11 2022] PUT /identity/v3/projects/d7afabbe358c445b87cf8e2a584a37e9/users/998821b3dbeb47ecbd58aba96168874c/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:11.838062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212cbfe-86e3-48a9-af64-fb94be675e29 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:11.838356 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212cbfe-86e3-48a9-af64-fb94be675e29 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:11.838632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212cbfe-86e3-48a9-af64-fb94be675e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:11.864490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9212cbfe-86e3-48a9-af64-fb94be675e29 None None] MFA Rules not processed for user `998821b3dbeb47ecbd58aba96168874c`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:11.865702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9212cbfe-86e3-48a9-af64-fb94be675e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:11.930088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1362/2740] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:11.941320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440d1dd-e501-436c-9594-d8ca4cb6b16b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:11.943540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4440d1dd-e501-436c-9594-d8ca4cb6b16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:12.001678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440d1dd-e501-436c-9594-d8ca4cb6b16b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:12.005400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214208-8af3-401e-b16e-87d156eae397 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbbc657ed3ae49dc9d45687c5dde2ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:12.005988 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214208-8af3-401e-b16e-87d156eae397 service glance] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:12.006274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214208-8af3-401e-b16e-87d156eae397 service glance] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:12.006553 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214208-8af3-401e-b16e-87d156eae397 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:12.015453 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214208-8af3-401e-b16e-87d156eae397 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:12.016863 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214208-8af3-401e-b16e-87d156eae397 service glance] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:12.025633 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1379/2741] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:21.927300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:22.021577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:38.146854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212cbfe-86e3-48a9-af64-fb94be675e29 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:38.148300 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9212cbfe-86e3-48a9-af64-fb94be675e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:38.211636 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212cbfe-86e3-48a9-af64-fb94be675e29 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:38.216354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:38.217235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:38.217517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:38.217788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] PATH_INFO: `/v3/users/656eb9274d854f0089dabdae712bcef0` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:38.218981 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656eb9274d854f0089dabdae712bcef0)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:38.220927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:38.428908 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656eb9274d854f0089dabdae712bcef0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:38.429499 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656eb9274d854f0089dabdae712bcef0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:38.441895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656eb9274d854f0089dabdae712bcef0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:38.448676 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656eb9274d854f0089dabdae712bcef0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:38.449331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656eb9274d854f0089dabdae712bcef0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:38.540466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1363/2742] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:25:38 2022] DELETE /identity/v3/users/656eb9274d854f0089dabdae712bcef0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:38.545368 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef1fe-f511-43ea-8c46-ba208e2efa3b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:38.553278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef1fe-f511-43ea-8c46-ba208e2efa3b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:38.553278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef1fe-f511-43ea-8c46-ba208e2efa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:38.563309 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-53eef1fe-f511-43ea-8c46-ba208e2efa3b None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:38.564577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-53eef1fe-f511-43ea-8c46-ba208e2efa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:38.621554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1380/2743] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:38.631666 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:38.633042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:38.710725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0289c-2b1d-484c-9540-29a8dce0e3d2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:38.714500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4e2a-0514-4203-92de-ed7820de4068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:38.715161 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4e2a-0514-4203-92de-ed7820de4068 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:38.715570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4e2a-0514-4203-92de-ed7820de4068 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:38.715854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4e2a-0514-4203-92de-ed7820de4068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:38.724836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa4e2a-0514-4203-92de-ed7820de4068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:38.726364 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa4e2a-0514-4203-92de-ed7820de4068 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:38.736866 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1364/2744] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:39.141093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eef1fe-f511-43ea-8c46-ba208e2efa3b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:39.144172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-53eef1fe-f511-43ea-8c46-ba208e2efa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:39.155031 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eef1fe-f511-43ea-8c46-ba208e2efa3b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:39.159712 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:39.160570 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:39.160855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:39.161125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] PATH_INFO: `/v3/projects/26f7fdbd96a24067874d745482459280` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:39.162338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f7fdbd96a24067874d745482459280)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:39.164295 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:39.268049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f7fdbd96a24067874d745482459280', 'request_id': 'req-33761ca1-0fa8-40d2-81eb-dc9d46ece559'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:39.274282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f7fdbd96a24067874d745482459280', 'request_id': 'req-33761ca1-0fa8-40d2-81eb-dc9d46ece559'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:39.352332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f7fdbd96a24067874d745482459280', 'request_id': 'req-33761ca1-0fa8-40d2-81eb-dc9d46ece559'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:39.363706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] The token cache is being invalidate because project 26f7fdbd96a24067874d745482459280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:25:39.363995 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:39.364619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-33761ca1-0fa8-40d2-81eb-dc9d46ece559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:39.366174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1381/2745] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:25:39 2022] DELETE /identity/v3/projects/26f7fdbd96a24067874d745482459280 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:47.856651 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4e2a-0514-4203-92de-ed7820de4068 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:47.858200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-33fa4e2a-0514-4203-92de-ed7820de4068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:47.866323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:47.871869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4e2a-0514-4203-92de-ed7820de4068 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:47.928489 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:47.932050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:47.932050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:47.932050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] PATH_INFO: `/v3/users/998821b3dbeb47ecbd58aba96168874c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:47.932050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=998821b3dbeb47ecbd58aba96168874c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:47.933135 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:48.137275 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998821b3dbeb47ecbd58aba96168874c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:48.137941 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998821b3dbeb47ecbd58aba96168874c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:48.149487 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998821b3dbeb47ecbd58aba96168874c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:48.156726 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998821b3dbeb47ecbd58aba96168874c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:48.157360 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998821b3dbeb47ecbd58aba96168874c'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:48.245594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1365/2746] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:25:47 2022] DELETE /identity/v3/users/998821b3dbeb47ecbd58aba96168874c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:48.249982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb68f95-eccb-424c-a44c-0831510b4a67 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:48.250499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb68f95-eccb-424c-a44c-0831510b4a67 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:48.250590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb68f95-eccb-424c-a44c-0831510b4a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:48.273206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1bb68f95-eccb-424c-a44c-0831510b4a67 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:48.274444 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1bb68f95-eccb-424c-a44c-0831510b4a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:48.335938 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1382/2747] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:25:48.346292 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:48.347723 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:48.406826 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92c1f-11d5-46bd-864b-d13de86ac494 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:48.410406 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0a5fc-8bf7-4296-9003-4f8efc589ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:48.411058 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0a5fc-8bf7-4296-9003-4f8efc589ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:48.411368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0a5fc-8bf7-4296-9003-4f8efc589ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:48.411646 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0a5fc-8bf7-4296-9003-4f8efc589ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:48.422035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0a5fc-8bf7-4296-9003-4f8efc589ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:48.423550 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0a5fc-8bf7-4296-9003-4f8efc589ad7 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:48.433591 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1366/2748] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:48.805721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb68f95-eccb-424c-a44c-0831510b4a67 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:48.807220 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1bb68f95-eccb-424c-a44c-0831510b4a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:48.820215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb68f95-eccb-424c-a44c-0831510b4a67 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:48.825707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:48.826573 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:48.826922 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:48.827293 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] PATH_INFO: `/v3/projects/d7afabbe358c445b87cf8e2a584a37e9` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:48.828586 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7afabbe358c445b87cf8e2a584a37e9)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:48.830611 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:48.855135 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:48.962979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7afabbe358c445b87cf8e2a584a37e9', 'request_id': 'req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:48.970907 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7afabbe358c445b87cf8e2a584a37e9', 'request_id': 'req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:49.067475 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7afabbe358c445b87cf8e2a584a37e9', 'request_id': 'req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:49.082627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] The token cache is being invalidate because project d7afabbe358c445b87cf8e2a584a37e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:25:49.083179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:49.084070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-2666b427-8596-4e2d-b9ae-9ad7a4dcd283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:25:49.086214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1383/2749] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:25:48 2022] DELETE /identity/v3/projects/d7afabbe358c445b87cf8e2a584a37e9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:25:49.091312 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a0b2e-0bbf-4600-a730-86beea7b0381 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:49.092132 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a0b2e-0bbf-4600-a730-86beea7b0381 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:49.093091 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a0b2e-0bbf-4600-a730-86beea7b0381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:49.123071 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-e98a0b2e-0bbf-4600-a730-86beea7b0381 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:49.124328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-e98a0b2e-0bbf-4600-a730-86beea7b0381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:49.134953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:49.203212 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1367/2750] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:49.268340 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d832-3438-4a97-adc5-ef6584bc7e02 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:49.268841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d832-3438-4a97-adc5-ef6584bc7e02 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:49.269049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d832-3438-4a97-adc5-ef6584bc7e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:49.294778 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-4ed6d832-3438-4a97-adc5-ef6584bc7e02 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:49.296203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4ed6d832-3438-4a97-adc5-ef6584bc7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:49.305120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1384/2751] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:49.309724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a0b2e-0bbf-4600-a730-86beea7b0381 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:49.319869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a0b2e-0bbf-4600-a730-86beea7b0381 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:49.325440 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb007e-92d8-4bef-a86d-2e479d1f7dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:49.326239 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb007e-92d8-4bef-a86d-2e479d1f7dad admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:49.326592 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb007e-92d8-4bef-a86d-2e479d1f7dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:49.326939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb007e-92d8-4bef-a86d-2e479d1f7dad admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:49.327765 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb007e-92d8-4bef-a86d-2e479d1f7dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:25:49.328216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb007e-92d8-4bef-a86d-2e479d1f7dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:49.329958 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb007e-92d8-4bef-a86d-2e479d1f7dad admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:49.343813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1368/2752] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:25:49.348072 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6d832-3438-4a97-adc5-ef6584bc7e02 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:49.359064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6d832-3438-4a97-adc5-ef6584bc7e02 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:49.364148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24cf0b-ab33-414d-b329-76640db194a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:49.368252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24cf0b-ab33-414d-b329-76640db194a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:49.368252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24cf0b-ab33-414d-b329-76640db194a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:49.368252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24cf0b-ab33-414d-b329-76640db194a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:49.368252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24cf0b-ab33-414d-b329-76640db194a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:49.368252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24cf0b-ab33-414d-b329-76640db194a2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:49.469658 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1385/2753] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:25:49 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:25:49.473441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb007e-92d8-4bef-a86d-2e479d1f7dad admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:49.484118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb007e-92d8-4bef-a86d-2e479d1f7dad admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:49.556687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4f3c-4fe9-4f9b-ae0b-743f621c751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:49.557365 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4f3c-4fe9-4f9b-ae0b-743f621c751f admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:49.557650 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4f3c-4fe9-4f9b-ae0b-743f621c751f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:49.557925 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee4f3c-4fe9-4f9b-ae0b-743f621c751f admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:49.558617 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee4f3c-4fe9-4f9b-ae0b-743f621c751f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:49.561178 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee4f3c-4fe9-4f9b-ae0b-743f621c751f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:49.663220 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1369/2754] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:25:49 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:25:49.666108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24cf0b-ab33-414d-b329-76640db194a2 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:49.676655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24cf0b-ab33-414d-b329-76640db194a2 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:49.681354 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec094eb-3b7d-4d87-88b4-e55ab7060ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:49.682013 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec094eb-3b7d-4d87-88b4-e55ab7060ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:49.682292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec094eb-3b7d-4d87-88b4-e55ab7060ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:49.682566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec094eb-3b7d-4d87-88b4-e55ab7060ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:49.683318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec094eb-3b7d-4d87-88b4-e55ab7060ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:49.685400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec094eb-3b7d-4d87-88b4-e55ab7060ba0 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:49.696464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1386/2755] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:49.701021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4f3c-4fe9-4f9b-ae0b-743f621c751f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:49.711835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee4f3c-4fe9-4f9b-ae0b-743f621c751f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:49.716701 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763de069-c6cb-4e04-8f42-dcc9166ed142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:49.717375 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763de069-c6cb-4e04-8f42-dcc9166ed142 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:49.717658 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763de069-c6cb-4e04-8f42-dcc9166ed142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:49.717936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763de069-c6cb-4e04-8f42-dcc9166ed142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:49.718813 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763de069-c6cb-4e04-8f42-dcc9166ed142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:49.720537 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763de069-c6cb-4e04-8f42-dcc9166ed142 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:49.734518 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1370/2756] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:25:49.736191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec094eb-3b7d-4d87-88b4-e55ab7060ba0 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:49.746244 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec094eb-3b7d-4d87-88b4-e55ab7060ba0 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:49.751414 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8707db0-4e57-4678-b023-a605255c9f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:49.752318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8707db0-4e57-4678-b023-a605255c9f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:49.752602 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8707db0-4e57-4678-b023-a605255c9f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:49.752876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8707db0-4e57-4678-b023-a605255c9f47 admin admin] PATH_INFO: `/v3/projects/e5b8100379874f6da5d5c872d2d3e103/users/70b0e2d2652f462da1e5d5899ce0dee0/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:49.767774 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8707db0-4e57-4678-b023-a605255c9f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b8100379874f6da5d5c872d2d3e103, user_id=70b0e2d2652f462da1e5d5899ce0dee0, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:49.770419 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8707db0-4e57-4678-b023-a605255c9f47 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:49.858677 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1387/2757] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:25:49 2022] PUT /identity/v3/projects/e5b8100379874f6da5d5c872d2d3e103/users/70b0e2d2652f462da1e5d5899ce0dee0/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:25:49.863808 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2b6b-ade8-4ba2-a3fa-2f7bab89aff2 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:49.864103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2b6b-ade8-4ba2-a3fa-2f7bab89aff2 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:49.864384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2b6b-ade8-4ba2-a3fa-2f7bab89aff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:49.883998 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-669b2b6b-ade8-4ba2-a3fa-2f7bab89aff2 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:49.885222 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-669b2b6b-ade8-4ba2-a3fa-2f7bab89aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:49.946169 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1371/2758] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:49.955808 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8707db0-4e57-4678-b023-a605255c9f47 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:49.960502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e8707db0-4e57-4678-b023-a605255c9f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:50.016934 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8707db0-4e57-4678-b023-a605255c9f47 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:50.020550 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfb8be-c5bf-4856-96df-add58fddb583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:50.021184 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfb8be-c5bf-4856-96df-add58fddb583 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:50.021461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfb8be-c5bf-4856-96df-add58fddb583 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:50.021728 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfb8be-c5bf-4856-96df-add58fddb583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:50.030578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfb8be-c5bf-4856-96df-add58fddb583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:50.032048 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfb8be-c5bf-4856-96df-add58fddb583 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:50.041235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1388/2759] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:51.565371 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa45e1-1d02-47f8-94b2-68307bbfe04c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:51.565862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa45e1-1d02-47f8-94b2-68307bbfe04c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:51.566075 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa45e1-1d02-47f8-94b2-68307bbfe04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:51.612033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-8faa45e1-1d02-47f8-94b2-68307bbfe04c None None] MFA Rules not processed for user `70b0e2d2652f462da1e5d5899ce0dee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:51.613283 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8faa45e1-1d02-47f8-94b2-68307bbfe04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:51.623403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:51.680526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1372/2760] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:51.691367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfb8be-c5bf-4856-96df-add58fddb583 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:51.692758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-2ebfb8be-c5bf-4856-96df-add58fddb583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:51.748270 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:51.775259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfb8be-c5bf-4856-96df-add58fddb583 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:51.779530 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e0950-6977-4737-888c-98d18d982f2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:51.780172 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e0950-6977-4737-888c-98d18d982f2e service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:51.780455 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e0950-6977-4737-888c-98d18d982f2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:51.780858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e0950-6977-4737-888c-98d18d982f2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:51.789704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e0950-6977-4737-888c-98d18d982f2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:51.791259 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e0950-6977-4737-888c-98d18d982f2e service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:51.801080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1389/2761] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:53.515017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fa5d4-5912-40f3-8ec4-1607eb93fa59 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:53.515604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fa5d4-5912-40f3-8ec4-1607eb93fa59 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:53.515604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fa5d4-5912-40f3-8ec4-1607eb93fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:53.533689 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b40fa5d4-5912-40f3-8ec4-1607eb93fa59 None None] MFA Rules not processed for user `70b0e2d2652f462da1e5d5899ce0dee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:25:53.534896 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b40fa5d4-5912-40f3-8ec4-1607eb93fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:53.541758 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1373/2762] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:25:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:25:53.787022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e0950-6977-4737-888c-98d18d982f2e service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:53.788471 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cd1e0950-6977-4737-888c-98d18d982f2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:53.800407 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e0950-6977-4737-888c-98d18d982f2e service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:53.804006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:53.804641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:53.804921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:53.805194 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:53.807020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:53.817185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:53.818589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:53.827114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1390/2763] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:54.212250 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fa5d4-5912-40f3-8ec4-1607eb93fa59 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:54.213632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b40fa5d4-5912-40f3-8ec4-1607eb93fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:54.291573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fa5d4-5912-40f3-8ec4-1607eb93fa59 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:54.297953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eb9c1-1402-482d-8f4b-59bc711c319a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:54.298606 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eb9c1-1402-482d-8f4b-59bc711c319a service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:54.298886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eb9c1-1402-482d-8f4b-59bc711c319a service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:54.299217 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eb9c1-1402-482d-8f4b-59bc711c319a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:54.301118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5d6eb9c1-1402-482d-8f4b-59bc711c319a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:54.313502 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eb9c1-1402-482d-8f4b-59bc711c319a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:54.315085 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eb9c1-1402-482d-8f4b-59bc711c319a service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:54.325492 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1374/2764] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:25:56.212925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:25:56.214496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:56.326872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd509f4-10eb-441e-abcc-50e22052ae94 service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:25:56.334077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db069b6-f687-43b5-88f8-5587a3390400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:25:56.334749 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db069b6-f687-43b5-88f8-5587a3390400 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:25:56.335034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db069b6-f687-43b5-88f8-5587a3390400 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:25:56.335338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db069b6-f687-43b5-88f8-5587a3390400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:25:56.337258 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-3db069b6-f687-43b5-88f8-5587a3390400 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:25:56.352742 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db069b6-f687-43b5-88f8-5587a3390400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:25:56.355408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db069b6-f687-43b5-88f8-5587a3390400 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:25:56.373479 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1391/2765] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:25:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:26:02.412463 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eb9c1-1402-482d-8f4b-59bc711c319a service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:02.423562 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eb9c1-1402-482d-8f4b-59bc711c319a service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:02.427323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:02.427974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:02.428257 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:02.428544 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:02.430703 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:02.443430 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:02.444888 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:02.455901 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1375/2766] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:26:04.639478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db069b6-f687-43b5-88f8-5587a3390400 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:04.652128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db069b6-f687-43b5-88f8-5587a3390400 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:04.657824 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:04.658483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:04.658783 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:04.659280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:04.662102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:04.674478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:04.676278 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:04.687665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1392/2767] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:26:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:26:06.157077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:06.158504 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:06.173433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f42232-21d3-4428-89ee-f65a0a837092 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:06.178449 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9a42-6cbf-40d2-ad2b-17306d5764d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:06.179154 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9a42-6cbf-40d2-ad2b-17306d5764d0 service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:06.179416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9a42-6cbf-40d2-ad2b-17306d5764d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:06.179691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9a42-6cbf-40d2-ad2b-17306d5764d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:06.181481 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-dd5a9a42-6cbf-40d2-ad2b-17306d5764d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:06.193887 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a9a42-6cbf-40d2-ad2b-17306d5764d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:06.195514 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a9a42-6cbf-40d2-ad2b-17306d5764d0 service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:06.205714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1376/2768] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:26:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:26:10.081177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:10.081177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:10.095589 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccba9f-bd3e-4f8b-8e93-abfbbb77ee85 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:10.100187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:10.101060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:10.101346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:10.101620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] PATH_INFO: `/v3/users/722fc8b42ea941499a56937ce0d8ad3a` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:10.103077 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=722fc8b42ea941499a56937ce0d8ad3a)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:10.105009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:10.299558 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722fc8b42ea941499a56937ce0d8ad3a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.300223 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722fc8b42ea941499a56937ce0d8ad3a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.300830 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722fc8b42ea941499a56937ce0d8ad3a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.313606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722fc8b42ea941499a56937ce0d8ad3a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.320638 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722fc8b42ea941499a56937ce0d8ad3a'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.393880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:10.398961 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1393/2769] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:26:10 2022] DELETE /identity/v3/users/722fc8b42ea941499a56937ce0d8ad3a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:26:10.650382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9a42-6cbf-40d2-ad2b-17306d5764d0 service placement] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:10.663340 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9a42-6cbf-40d2-ad2b-17306d5764d0 service placement] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:10.731443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:10.732820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:10.733103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:10.733437 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] PATH_INFO: `/v3/projects/21c0abf697ed4e29870a594ed83de6c7` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:10.734721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c0abf697ed4e29870a594ed83de6c7)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:10.736899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:10.747715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:10.843717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c0abf697ed4e29870a594ed83de6c7', 'request_id': 'req-c8f74367-6716-4640-92a3-bc707c275e29'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.850166 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c0abf697ed4e29870a594ed83de6c7', 'request_id': 'req-c8f74367-6716-4640-92a3-bc707c275e29'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.912036 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c0abf697ed4e29870a594ed83de6c7', 'request_id': 'req-c8f74367-6716-4640-92a3-bc707c275e29'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.923495 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] The token cache is being invalidate because project 21c0abf697ed4e29870a594ed83de6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:26:10.923785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.924410 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:10.926034 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1377/2770] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:26:10 2022] DELETE /identity/v3/projects/21c0abf697ed4e29870a594ed83de6c7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:26:10.929936 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:10.931381 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:10.944773 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b834-f8d0-4e75-ba63-15d74e001f2b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:11.001650 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:11.002443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:11.002725 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:11.003002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] PATH_INFO: `/v3/users/4f3a7935830c46f6b0bd65e0bbf4d3b3` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:11.004222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3a7935830c46f6b0bd65e0bbf4d3b3)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:11.006235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:11.200262 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3a7935830c46f6b0bd65e0bbf4d3b3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.200892 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3a7935830c46f6b0bd65e0bbf4d3b3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.201512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3a7935830c46f6b0bd65e0bbf4d3b3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.213269 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3a7935830c46f6b0bd65e0bbf4d3b3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.220554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-36ce661b-ac50-411a-bfff-f377ed66577a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3a7935830c46f6b0bd65e0bbf4d3b3'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.347812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1394/2771] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:26:10 2022] DELETE /identity/v3/users/4f3a7935830c46f6b0bd65e0bbf4d3b3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:26:11.611598 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:11.613377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:11.628210 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f74367-6716-4640-92a3-bc707c275e29 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:11.687366 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:11.692996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:11.692996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:11.692996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] PATH_INFO: `/v3/projects/cdc62cbe60f84cbda80e7f9831e627dd` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:11.692996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc62cbe60f84cbda80e7f9831e627dd)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:11.692996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:11.809404 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc62cbe60f84cbda80e7f9831e627dd', 'request_id': 'req-762272be-8009-4487-8f89-f08d83043d5e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.815500 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc62cbe60f84cbda80e7f9831e627dd', 'request_id': 'req-762272be-8009-4487-8f89-f08d83043d5e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.912113 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc62cbe60f84cbda80e7f9831e627dd', 'request_id': 'req-762272be-8009-4487-8f89-f08d83043d5e'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.923304 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] The token cache is being invalidate because project cdc62cbe60f84cbda80e7f9831e627dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:26:11.923594 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.924214 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:11.925754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1378/2772] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:26:11 2022] DELETE /identity/v3/projects/cdc62cbe60f84cbda80e7f9831e627dd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:26:12.200356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5d33-29ce-404a-aa53-a3024492e524 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:12.200826 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5d33-29ce-404a-aa53-a3024492e524 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:12.201435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5d33-29ce-404a-aa53-a3024492e524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:12.218846 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-695e5d33-29ce-404a-aa53-a3024492e524 None None] MFA Rules not processed for user `70b0e2d2652f462da1e5d5899ce0dee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:26:12.220055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-695e5d33-29ce-404a-aa53-a3024492e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:12.276245 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1395/2773] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:26:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:26:21.919540 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=71,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:21.993690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:21.993690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:22.051926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762272be-8009-4487-8f89-f08d83043d5e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:22.055588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0557e2-65a4-4f99-b2e6-0d0746d6dcc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:22.056252 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0557e2-65a4-4f99-b2e6-0d0746d6dcc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:22.056522 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0557e2-65a4-4f99-b2e6-0d0746d6dcc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:22.056794 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0557e2-65a4-4f99-b2e6-0d0746d6dcc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:22.059859 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3a0557e2-65a4-4f99-b2e6-0d0746d6dcc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:22.121286 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0557e2-65a4-4f99-b2e6-0d0746d6dcc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:22.122713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0557e2-65a4-4f99-b2e6-0d0746d6dcc1 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:22.132416 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1379/2774] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:26:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:26:22.268868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:25.600383 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5d33-29ce-404a-aa53-a3024492e524 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:25.601846 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-695e5d33-29ce-404a-aa53-a3024492e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:25.691702 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5d33-29ce-404a-aa53-a3024492e524 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:25.698334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:25.699441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:25.699441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:25.699663 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:25.701389 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:25.713585 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:25.715216 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:25.725452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1396/2775] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:26:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:26:30.278503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483b81f-692e-4ed0-b31c-82c671802544 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:30.278996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483b81f-692e-4ed0-b31c-82c671802544 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:30.279157 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483b81f-692e-4ed0-b31c-82c671802544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:30.297022 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9483b81f-692e-4ed0-b31c-82c671802544 None None] MFA Rules not processed for user `3a59ab67afb940fe96373251e2e80cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:26:30.298231 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9483b81f-692e-4ed0-b31c-82c671802544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:30.305613 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1380/2776] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:26:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:26:30.616313 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:30.622002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:30.681056 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90da7d-2893-4b0b-b3ca-9809663adf05 service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:30.684656 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:30.685290 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:30.685570 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:30.685843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:30.687619 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:30.696944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:30.698344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:30.706463 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1397/2777] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:26:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:26:36.643935 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d7046-86a6-47c0-8b8c-4326ec652e67 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:36.644475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d7046-86a6-47c0-8b8c-4326ec652e67 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:36.644475 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d7046-86a6-47c0-8b8c-4326ec652e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:36.676100 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d39d7046-86a6-47c0-8b8c-4326ec652e67 None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:26:36.677324 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d39d7046-86a6-47c0-8b8c-4326ec652e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:36.745769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1381/2778] 10.222.0.13 () {58 vars in 1009 bytes} [Thu Jun 2 10:26:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:26:36.851307 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:36.853155 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:36.930373 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc400f84-879a-4b59-bf19-2e2968a8436b service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:36.936154 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f9130-04c8-4799-bb3e-650fdead8591 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:36.936838 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f9130-04c8-4799-bb3e-650fdead8591 service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:36.937118 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f9130-04c8-4799-bb3e-650fdead8591 service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:36.937391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f9130-04c8-4799-bb3e-650fdead8591 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:36.945903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f9130-04c8-4799-bb3e-650fdead8591 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:36.947510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f9130-04c8-4799-bb3e-650fdead8591 service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:36.955868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1398/2779] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:26:46.737848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=83 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:46.952634 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=99 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:53.136561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bd7b6-c105-462c-bdd6-ddbf9fcbcdab None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:53.137003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bd7b6-c105-462c-bdd6-ddbf9fcbcdab None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:53.137099 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bd7b6-c105-462c-bdd6-ddbf9fcbcdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:53.155370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-0e3bd7b6-c105-462c-bdd6-ddbf9fcbcdab None None] MFA Rules not processed for user `b548998a91fb40519f794668c5c566af`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:26:53.157073 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e3bd7b6-c105-462c-bdd6-ddbf9fcbcdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:53.164008 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1382/2780] 10.222.0.13 () {58 vars in 967 bytes} [Thu Jun 2 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:26:53.176234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f9130-04c8-4799-bb3e-650fdead8591 service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:53.186499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f9130-04c8-4799-bb3e-650fdead8591 service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:53.191581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8234-4928-4b0f-a774-b86e9dbeb70d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbe700a0ebc48b5953a600400ecfed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:53.192213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8234-4928-4b0f-a774-b86e9dbeb70d service swift] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:53.192494 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8234-4928-4b0f-a774-b86e9dbeb70d service swift] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:53.192770 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8234-4928-4b0f-a774-b86e9dbeb70d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:53.200760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a8234-4928-4b0f-a774-b86e9dbeb70d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:53.202319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a8234-4928-4b0f-a774-b86e9dbeb70d service swift] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:53.210343 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1399/2781] 10.222.0.13 () {60 vars in 1384 bytes} [Thu Jun 2 10:26:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:26:55.970553 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bd7b6-c105-462c-bdd6-ddbf9fcbcdab None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:55.972098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0e3bd7b6-c105-462c-bdd6-ddbf9fcbcdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:56.171171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bd7b6-c105-462c-bdd6-ddbf9fcbcdab None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:56.175706 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:56.176563 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:56.176842 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:56.177118 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] PATH_INFO: `/v3/users/70b0e2d2652f462da1e5d5899ce0dee0` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:56.178301 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b0e2d2652f462da1e5d5899ce0dee0)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:56.180245 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:56.374595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b0e2d2652f462da1e5d5899ce0dee0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.375276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b0e2d2652f462da1e5d5899ce0dee0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.388788 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b0e2d2652f462da1e5d5899ce0dee0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.395467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b0e2d2652f462da1e5d5899ce0dee0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.396127 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-89349a97-4f2c-46c4-a1a1-3b61df977086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b0e2d2652f462da1e5d5899ce0dee0'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.474799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1383/2782] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:26:55 2022] DELETE /identity/v3/users/70b0e2d2652f462da1e5d5899ce0dee0 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:26:56.722912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8234-4928-4b0f-a774-b86e9dbeb70d service swift] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:56.734576 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8234-4928-4b0f-a774-b86e9dbeb70d service swift] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:56.792697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:56.793560 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:56.793837 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:56.794106 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] PATH_INFO: `/v3/projects/e5b8100379874f6da5d5c872d2d3e103` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:56.795291 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b8100379874f6da5d5c872d2d3e103)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:56.797173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:56.904891 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b8100379874f6da5d5c872d2d3e103', 'request_id': 'req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.911321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b8100379874f6da5d5c872d2d3e103', 'request_id': 'req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.968299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b8100379874f6da5d5c872d2d3e103', 'request_id': 'req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.979400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] The token cache is being invalidate because project e5b8100379874f6da5d5c872d2d3e103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:26:56.979684 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.980299 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-66666b7f-1218-46c0-a3d0-ad1c22fa7a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:26:56.981841 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1400/2783] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:26:56 2022] DELETE /identity/v3/projects/e5b8100379874f6da5d5c872d2d3e103 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:26:56.988511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccf944-f96c-4645-a849-7583543ec9fa None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:56.988987 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccf944-f96c-4645-a849-7583543ec9fa None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:56.989106 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccf944-f96c-4645-a849-7583543ec9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.007244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-74ccf944-f96c-4645-a849-7583543ec9fa None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:26:57.008442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-74ccf944-f96c-4645-a849-7583543ec9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:57.070209 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1384/2784] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:26:57.076510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bebb2-8e56-47b4-9b18-08d4f3b28df5 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:57.076793 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bebb2-8e56-47b4-9b18-08d4f3b28df5 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:57.077065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bebb2-8e56-47b4-9b18-08d4f3b28df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.096525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-fa8bebb2-8e56-47b4-9b18-08d4f3b28df5 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:26:57.097731 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fa8bebb2-8e56-47b4-9b18-08d4f3b28df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:57.106002 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1401/2785] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:26:57.110003 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccf944-f96c-4645-a849-7583543ec9fa None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:57.119501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccf944-f96c-4645-a849-7583543ec9fa None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:57.124171 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf32f3-ef85-4e64-aaf8-9a1a79acc74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:57.124816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf32f3-ef85-4e64-aaf8-9a1a79acc74a admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:57.125093 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf32f3-ef85-4e64-aaf8-9a1a79acc74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:57.125359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf32f3-ef85-4e64-aaf8-9a1a79acc74a admin admin] PATH_INFO: `/v3/domains` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.126070 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf32f3-ef85-4e64-aaf8-9a1a79acc74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:26:57.126373 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf32f3-ef85-4e64-aaf8-9a1a79acc74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:57.127993 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf32f3-ef85-4e64-aaf8-9a1a79acc74a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:57.136354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:57.139508 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1385/2786] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:26:57.144161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bebb2-8e56-47b4-9b18-08d4f3b28df5 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:57.153021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bebb2-8e56-47b4-9b18-08d4f3b28df5 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:57.158361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a2e60-2c97-4a5f-b0cb-8f782c8d24ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:57.158991 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a2e60-2c97-4a5f-b0cb-8f782c8d24ca admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:57.159296 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a2e60-2c97-4a5f-b0cb-8f782c8d24ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:57.159569 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a2e60-2c97-4a5f-b0cb-8f782c8d24ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.160241 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a2e60-2c97-4a5f-b0cb-8f782c8d24ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:57.162112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a2e60-2c97-4a5f-b0cb-8f782c8d24ca admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:57.267610 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1402/2787] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:26:57 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:26:57.271755 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf32f3-ef85-4e64-aaf8-9a1a79acc74a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:57.281722 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf32f3-ef85-4e64-aaf8-9a1a79acc74a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:57.337869 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a059-0924-4ba1-82a6-cd79a7767a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:57.338467 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a059-0924-4ba1-82a6-cd79a7767a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:57.338744 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a059-0924-4ba1-82a6-cd79a7767a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:57.339012 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a059-0924-4ba1-82a6-cd79a7767a9d admin admin] PATH_INFO: `/v3/users` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.339721 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6a059-0924-4ba1-82a6-cd79a7767a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:57.341659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6a059-0924-4ba1-82a6-cd79a7767a9d admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:57.435044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1386/2788] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:26:57 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:26:57.439204 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a2e60-2c97-4a5f-b0cb-8f782c8d24ca admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:57.449566 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a2e60-2c97-4a5f-b0cb-8f782c8d24ca admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:57.454175 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5112-dfe6-46d9-bfee-90448afd6bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:57.454829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5112-dfe6-46d9-bfee-90448afd6bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:57.455131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5112-dfe6-46d9-bfee-90448afd6bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:57.455409 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5112-dfe6-46d9-bfee-90448afd6bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.456131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d5112-dfe6-46d9-bfee-90448afd6bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:57.457758 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d5112-dfe6-46d9-bfee-90448afd6bfc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:57.468273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1403/2789] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:26:57.472603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a059-0924-4ba1-82a6-cd79a7767a9d admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:57.482552 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a059-0924-4ba1-82a6-cd79a7767a9d admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:57.487762 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6baf5-bf49-4946-9068-0112f6696083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:57.488405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6baf5-bf49-4946-9068-0112f6696083 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:57.488685 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6baf5-bf49-4946-9068-0112f6696083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:57.488953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6baf5-bf49-4946-9068-0112f6696083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.489659 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6baf5-bf49-4946-9068-0112f6696083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:57.491244 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6baf5-bf49-4946-9068-0112f6696083 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:57.500839 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1387/2790] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:26:57.504736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5112-dfe6-46d9-bfee-90448afd6bfc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:57.514377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5112-dfe6-46d9-bfee-90448afd6bfc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:57.518937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2350f-7d5e-4797-a7e8-f797d8851081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:57.519832 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2350f-7d5e-4797-a7e8-f797d8851081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:57.520112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2350f-7d5e-4797-a7e8-f797d8851081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:57.520384 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2350f-7d5e-4797-a7e8-f797d8851081 admin admin] PATH_INFO: `/v3/projects/44ac8973bd2d44909beac9492351eb31/users/99bf4ea32e73408bb8adadf880c900de/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.534872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2350f-7d5e-4797-a7e8-f797d8851081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ac8973bd2d44909beac9492351eb31, user_id=99bf4ea32e73408bb8adadf880c900de, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:57.537510 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2350f-7d5e-4797-a7e8-f797d8851081 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:57.607284 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1404/2791] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:26:57 2022] PUT /identity/v3/projects/44ac8973bd2d44909beac9492351eb31/users/99bf4ea32e73408bb8adadf880c900de/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:26:57.618442 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929ecd2-240e-437e-b443-e977dde8384a None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:57.618732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929ecd2-240e-437e-b443-e977dde8384a None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:57.619009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929ecd2-240e-437e-b443-e977dde8384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.644996 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-9929ecd2-240e-437e-b443-e977dde8384a None None] MFA Rules not processed for user `99bf4ea32e73408bb8adadf880c900de`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:26:57.646200 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9929ecd2-240e-437e-b443-e977dde8384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:57.710045 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1388/2792] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:26:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:26:57.721130 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2350f-7d5e-4797-a7e8-f797d8851081 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:57.722849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6aa2350f-7d5e-4797-a7e8-f797d8851081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:57.737978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:57.780752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2350f-7d5e-4797-a7e8-f797d8851081 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:57.785006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c617b-4b5b-48da-a756-a31791b0d006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:57.785645 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c617b-4b5b-48da-a756-a31791b0d006 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:57.785930 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c617b-4b5b-48da-a756-a31791b0d006 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:57.786208 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c617b-4b5b-48da-a756-a31791b0d006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:57.794716 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c617b-4b5b-48da-a756-a31791b0d006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:57.796165 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c617b-4b5b-48da-a756-a31791b0d006 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:57.804791 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1405/2793] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:26:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:27:07.707186 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:27:07.848201 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=20 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:27:21.421470 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929ecd2-240e-437e-b443-e977dde8384a None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:27:21.482588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929ecd2-240e-437e-b443-e977dde8384a None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:27:21.487713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:27:21.488612 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:27:21.488894 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:27:21.489167 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] PATH_INFO: `/v3/users/99bf4ea32e73408bb8adadf880c900de` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:27:21.490335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bf4ea32e73408bb8adadf880c900de)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:27:21.492268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:27:21.666886 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bf4ea32e73408bb8adadf880c900de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:21.667558 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bf4ea32e73408bb8adadf880c900de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:21.679939 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bf4ea32e73408bb8adadf880c900de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:21.686724 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bf4ea32e73408bb8adadf880c900de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:21.691640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bf4ea32e73408bb8adadf880c900de'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:21.773320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1389/2794] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:27:21 2022] DELETE /identity/v3/users/99bf4ea32e73408bb8adadf880c900de => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:27:21.777848 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c1780-47c1-4192-8a01-b676c5661858 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:27:21.778358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c1780-47c1-4192-8a01-b676c5661858 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:27:21.778358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c1780-47c1-4192-8a01-b676c5661858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:27:21.795534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-cd6c1780-47c1-4192-8a01-b676c5661858 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:27:21.796706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cd6c1780-47c1-4192-8a01-b676c5661858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:27:21.853889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1406/2795] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:27:21.863490 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:27:21.864967 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:27:21.920847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255a117-5ba7-4e47-b588-4cc8205c0769 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:27:21.924354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2df006-5930-4a8b-9050-cb8cbcec9aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:27:21.925015 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2df006-5930-4a8b-9050-cb8cbcec9aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:27:21.925296 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2df006-5930-4a8b-9050-cb8cbcec9aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:27:21.925570 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2df006-5930-4a8b-9050-cb8cbcec9aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:27:21.935370 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2df006-5930-4a8b-9050-cb8cbcec9aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:27:21.936790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2df006-5930-4a8b-9050-cb8cbcec9aa6 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:27:21.946120 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1390/2796] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:27:22.352686 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c1780-47c1-4192-8a01-b676c5661858 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:27:22.354108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-cd6c1780-47c1-4192-8a01-b676c5661858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:27:22.366370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c1780-47c1-4192-8a01-b676c5661858 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:27:22.370924 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:27:22.371912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:27:22.377157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:27:22.377157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] PATH_INFO: `/v3/projects/44ac8973bd2d44909beac9492351eb31` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:27:22.377157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ac8973bd2d44909beac9492351eb31)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:27:22.377157 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:27:22.481872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ac8973bd2d44909beac9492351eb31', 'request_id': 'req-ffb19abd-666b-4c22-8483-6327c8f4f685'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:22.488425 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ac8973bd2d44909beac9492351eb31', 'request_id': 'req-ffb19abd-666b-4c22-8483-6327c8f4f685'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:22.566652 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ac8973bd2d44909beac9492351eb31', 'request_id': 'req-ffb19abd-666b-4c22-8483-6327c8f4f685'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:22.577603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] The token cache is being invalidate because project 44ac8973bd2d44909beac9492351eb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:27:22.577890 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:22.578511 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:27:22.580092 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1407/2797] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:27:22 2022] DELETE /identity/v3/projects/44ac8973bd2d44909beac9492351eb31 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:27:31.941995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:27:32.574274 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:08.823681 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2df006-5930-4a8b-9050-cb8cbcec9aa6 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:08.825072 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-0c2df006-5930-4a8b-9050-cb8cbcec9aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:08.882845 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2df006-5930-4a8b-9050-cb8cbcec9aa6 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:08.929609 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:08.930247 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:08.930529 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:08.930840 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:08.932632 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:09.012644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:09.014062 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:09.034311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1391/2798] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:28:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:28:19.031816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=83 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:19.562872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:19.564329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:19.576605 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb19abd-666b-4c22-8483-6327c8f4f685 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:19.580231 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:19.580870 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:19.581180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:19.581461 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:19.583762 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:19.596873 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:19.598226 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:19.609971 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1408/2799] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:28:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:28:29.605178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:42.293323 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:42.294725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:42.351243 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c92f8-ac30-4281-8021-9bc66a9ef6f2 service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:42.354875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4481fce-f2eb-49f9-8aa8-0cd7910a099b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:42.355588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4481fce-f2eb-49f9-8aa8-0cd7910a099b service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:42.360856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4481fce-f2eb-49f9-8aa8-0cd7910a099b service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:42.360856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4481fce-f2eb-49f9-8aa8-0cd7910a099b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:42.360856 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f4481fce-f2eb-49f9-8aa8-0cd7910a099b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:42.420059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4481fce-f2eb-49f9-8aa8-0cd7910a099b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:42.421484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4481fce-f2eb-49f9-8aa8-0cd7910a099b service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:42.430928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1392/2800] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:28:45.835388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:45.836864 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:45.851981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2ae5-269f-4cbe-967f-7fc848062777 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:45.856591 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:45.857459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:45.857736 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:45.858006 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] PATH_INFO: `/v3/users/3a59ab67afb940fe96373251e2e80cf6` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:45.859206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a59ab67afb940fe96373251e2e80cf6)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:45.861083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:46.053328 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a59ab67afb940fe96373251e2e80cf6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.053978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a59ab67afb940fe96373251e2e80cf6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.054576 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a59ab67afb940fe96373251e2e80cf6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.066568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a59ab67afb940fe96373251e2e80cf6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.073531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-5aa74f4d-df04-412b-9eb1-344eac265dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a59ab67afb940fe96373251e2e80cf6'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.157768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1409/2801] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:28:45 2022] DELETE /identity/v3/users/3a59ab67afb940fe96373251e2e80cf6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:46.428149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4481fce-f2eb-49f9-8aa8-0cd7910a099b service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:46.438969 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4481fce-f2eb-49f9-8aa8-0cd7910a099b service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:46.495450 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:46.496307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:46.496588 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:46.496857 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] PATH_INFO: `/v3/projects/2083731013634acc8fcf98adceb19061` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:46.498064 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2083731013634acc8fcf98adceb19061)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:46.500000 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:46.594785 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2083731013634acc8fcf98adceb19061', 'request_id': 'req-fd102b6b-739f-47ec-813c-1a4b29bf3207'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.596638 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:46.601320 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2083731013634acc8fcf98adceb19061', 'request_id': 'req-fd102b6b-739f-47ec-813c-1a4b29bf3207'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.652077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2083731013634acc8fcf98adceb19061', 'request_id': 'req-fd102b6b-739f-47ec-813c-1a4b29bf3207'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.662335 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] The token cache is being invalidate because project 2083731013634acc8fcf98adceb19061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:28:46.663960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.663960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-fd102b6b-739f-47ec-813c-1a4b29bf3207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:46.664957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1393/2802] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:28:46 2022] DELETE /identity/v3/projects/2083731013634acc8fcf98adceb19061 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:46.669880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323011a-be55-48f2-90bc-b17ea80aac46 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:46.670164 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323011a-be55-48f2-90bc-b17ea80aac46 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:46.670439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323011a-be55-48f2-90bc-b17ea80aac46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:46.687889 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-1323011a-be55-48f2-90bc-b17ea80aac46 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:46.689009 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-1323011a-be55-48f2-90bc-b17ea80aac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:46.747427 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1410/2803] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:46.755741 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fb815-7526-4b26-846c-dcd575f571f7 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:46.756033 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fb815-7526-4b26-846c-dcd575f571f7 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:46.756315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fb815-7526-4b26-846c-dcd575f571f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:46.774398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-d55fb815-7526-4b26-846c-dcd575f571f7 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:46.775624 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-d55fb815-7526-4b26-846c-dcd575f571f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:46.783426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1394/2804] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:46.787441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323011a-be55-48f2-90bc-b17ea80aac46 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:46.796951 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323011a-be55-48f2-90bc-b17ea80aac46 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:46.801987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9874d8-2757-4237-8c3e-9af7e77c8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:46.802634 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9874d8-2757-4237-8c3e-9af7e77c8534 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:46.802915 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9874d8-2757-4237-8c3e-9af7e77c8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:46.803221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9874d8-2757-4237-8c3e-9af7e77c8534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:46.803945 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9874d8-2757-4237-8c3e-9af7e77c8534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:28:46.804252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9874d8-2757-4237-8c3e-9af7e77c8534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:46.805813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9874d8-2757-4237-8c3e-9af7e77c8534 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:46.817733 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1411/2805] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:28:46.821557 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fb815-7526-4b26-846c-dcd575f571f7 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:46.830593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fb815-7526-4b26-846c-dcd575f571f7 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:46.835742 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb175f7-27f2-4257-b980-3224f2a55bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:46.836398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb175f7-27f2-4257-b980-3224f2a55bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:46.836687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb175f7-27f2-4257-b980-3224f2a55bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:46.836966 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb175f7-27f2-4257-b980-3224f2a55bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:46.837663 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb175f7-27f2-4257-b980-3224f2a55bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:46.839599 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb175f7-27f2-4257-b980-3224f2a55bf2 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:46.907425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1395/2806] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:28:46 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:46.912007 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9874d8-2757-4237-8c3e-9af7e77c8534 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:46.921792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9874d8-2757-4237-8c3e-9af7e77c8534 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:46.977370 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e18ca9-cadc-4b74-8a62-f0d796a52a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:46.977960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e18ca9-cadc-4b74-8a62-f0d796a52a2b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:46.978242 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e18ca9-cadc-4b74-8a62-f0d796a52a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:46.978513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e18ca9-cadc-4b74-8a62-f0d796a52a2b admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:46.979224 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e18ca9-cadc-4b74-8a62-f0d796a52a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:46.981099 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e18ca9-cadc-4b74-8a62-f0d796a52a2b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:46.987627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:47.055329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1412/2807] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:28:46 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:47.059236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb175f7-27f2-4257-b980-3224f2a55bf2 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:47.069458 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb175f7-27f2-4257-b980-3224f2a55bf2 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:47.074061 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980852-da87-4272-b524-ad3a8073e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:47.074709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980852-da87-4272-b524-ad3a8073e19b admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:47.074989 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980852-da87-4272-b524-ad3a8073e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:47.075290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980852-da87-4272-b524-ad3a8073e19b admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:47.076009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd980852-da87-4272-b524-ad3a8073e19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:47.077579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd980852-da87-4272-b524-ad3a8073e19b admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:47.088639 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1396/2808] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:28:47.094668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e18ca9-cadc-4b74-8a62-f0d796a52a2b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:47.105538 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e18ca9-cadc-4b74-8a62-f0d796a52a2b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:47.110489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f268b52-ac81-47bb-978b-75325f162a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:47.111182 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f268b52-ac81-47bb-978b-75325f162a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:47.111466 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f268b52-ac81-47bb-978b-75325f162a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:47.111743 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f268b52-ac81-47bb-978b-75325f162a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:47.112460 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f268b52-ac81-47bb-978b-75325f162a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:47.114053 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f268b52-ac81-47bb-978b-75325f162a1c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:47.124071 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1413/2809] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:28:47.128114 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980852-da87-4272-b524-ad3a8073e19b admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:47.138815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980852-da87-4272-b524-ad3a8073e19b admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:47.143578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c66db5-fea1-46c4-a4ad-f0cd85215d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:47.145102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c66db5-fea1-46c4-a4ad-f0cd85215d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:47.145382 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c66db5-fea1-46c4-a4ad-f0cd85215d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:47.145653 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c66db5-fea1-46c4-a4ad-f0cd85215d77 admin admin] PATH_INFO: `/v3/projects/8ea49471d9514e72a2286bfd207b6d84/users/fcd02635729c48aa970c2598c19ede56/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:47.159804 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c66db5-fea1-46c4-a4ad-f0cd85215d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea49471d9514e72a2286bfd207b6d84, user_id=fcd02635729c48aa970c2598c19ede56, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:47.162447 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c66db5-fea1-46c4-a4ad-f0cd85215d77 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:47.245635 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1397/2810] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:28:47 2022] PUT /identity/v3/projects/8ea49471d9514e72a2286bfd207b6d84/users/fcd02635729c48aa970c2598c19ede56/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:28:47.261020 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815fdf9-8ca4-4874-801e-21b67b23f343 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:47.261353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815fdf9-8ca4-4874-801e-21b67b23f343 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:47.261662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815fdf9-8ca4-4874-801e-21b67b23f343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:47.288937 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8815fdf9-8ca4-4874-801e-21b67b23f343 None None] MFA Rules not processed for user `fcd02635729c48aa970c2598c19ede56`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:47.290131 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8815fdf9-8ca4-4874-801e-21b67b23f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:47.353074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1414/2811] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:47.364223 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c66db5-fea1-46c4-a4ad-f0cd85215d77 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:47.367392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a5c66db5-fea1-46c4-a4ad-f0cd85215d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:47.437895 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c66db5-fea1-46c4-a4ad-f0cd85215d77 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:47.444010 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77f57e-c395-404c-b71f-49b6a6d7a062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:47.444644 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f57e-c395-404c-b71f-49b6a6d7a062 service nova] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:47.444929 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f57e-c395-404c-b71f-49b6a6d7a062 service nova] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:47.445205 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f57e-c395-404c-b71f-49b6a6d7a062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:47.452907 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77f57e-c395-404c-b71f-49b6a6d7a062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:47.454472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77f57e-c395-404c-b71f-49b6a6d7a062 service nova] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:47.463833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1398/2812] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:28:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:28:47.678590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815fdf9-8ca4-4874-801e-21b67b23f343 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:47.741741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815fdf9-8ca4-4874-801e-21b67b23f343 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:47.746316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:47.747213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:47.747496 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:47.747772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] PATH_INFO: `/v3/users/fcd02635729c48aa970c2598c19ede56` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:47.749000 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd02635729c48aa970c2598c19ede56)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:47.750884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:47.914557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd02635729c48aa970c2598c19ede56'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:47.915222 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd02635729c48aa970c2598c19ede56'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:47.915801 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd02635729c48aa970c2598c19ede56'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:47.928441 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd02635729c48aa970c2598c19ede56'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:47.932835 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:47.935665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd02635729c48aa970c2598c19ede56'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:47.986138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1415/2813] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:28:47 2022] DELETE /identity/v3/users/fcd02635729c48aa970c2598c19ede56 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:47.991185 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b1c2-ff06-4174-a0d5-fcc3a754e178 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:47.991472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b1c2-ff06-4174-a0d5-fcc3a754e178 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:47.991746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b1c2-ff06-4174-a0d5-fcc3a754e178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:48.008361 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-2178b1c2-ff06-4174-a0d5-fcc3a754e178 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:48.009474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2178b1c2-ff06-4174-a0d5-fcc3a754e178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:48.068764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1399/2814] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:48.078167 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:48.079577 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:48.136800 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a0e80-2df7-4504-beee-1bbe4f31d2be admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:48.140467 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9df2f-7762-4454-8bfa-55e107dff404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:48.141107 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9df2f-7762-4454-8bfa-55e107dff404 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:48.141388 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9df2f-7762-4454-8bfa-55e107dff404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:48.141661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9df2f-7762-4454-8bfa-55e107dff404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:48.150666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9df2f-7762-4454-8bfa-55e107dff404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:48.152129 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9df2f-7762-4454-8bfa-55e107dff404 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:48.162027 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1416/2815] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:28:48.526532 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178b1c2-ff06-4174-a0d5-fcc3a754e178 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:48.528088 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-2178b1c2-ff06-4174-a0d5-fcc3a754e178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:48.535793 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:48.541042 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178b1c2-ff06-4174-a0d5-fcc3a754e178 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:48.545937 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:48.546803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:48.547074 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:48.547432 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] PATH_INFO: `/v3/projects/8ea49471d9514e72a2286bfd207b6d84` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:48.548616 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea49471d9514e72a2286bfd207b6d84)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:48.550520 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:48.649637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea49471d9514e72a2286bfd207b6d84', 'request_id': 'req-87482813-3a79-4e2b-be7b-98152e8c01d3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:48.655864 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea49471d9514e72a2286bfd207b6d84', 'request_id': 'req-87482813-3a79-4e2b-be7b-98152e8c01d3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:48.712769 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea49471d9514e72a2286bfd207b6d84', 'request_id': 'req-87482813-3a79-4e2b-be7b-98152e8c01d3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:48.723306 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] The token cache is being invalidate because project 8ea49471d9514e72a2286bfd207b6d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:28:48.723809 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:48.725295 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-87482813-3a79-4e2b-be7b-98152e8c01d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:48.726906 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1400/2816] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:28:48 2022] DELETE /identity/v3/projects/8ea49471d9514e72a2286bfd207b6d84 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:48.732792 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0aa81-f32b-449d-bff5-4d9420602d78 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:48.733074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0aa81-f32b-449d-bff5-4d9420602d78 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:48.733345 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0aa81-f32b-449d-bff5-4d9420602d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:48.750547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-81b0aa81-f32b-449d-bff5-4d9420602d78 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:48.751796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-81b0aa81-f32b-449d-bff5-4d9420602d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:48.811661 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1417/2817] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:48.820867 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66ad0-ac04-4dee-96fc-ff59a644ee64 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:48.821150 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66ad0-ac04-4dee-96fc-ff59a644ee64 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:48.821423 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66ad0-ac04-4dee-96fc-ff59a644ee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:48.839676 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ffb66ad0-ac04-4dee-96fc-ff59a644ee64 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:48.840847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ffb66ad0-ac04-4dee-96fc-ff59a644ee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:48.848851 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1401/2818] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:48.853169 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0aa81-f32b-449d-bff5-4d9420602d78 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:48.862662 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0aa81-f32b-449d-bff5-4d9420602d78 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:48.867238 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4a1de-c910-44cd-a429-fa4d7a43c53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:48.876375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4a1de-c910-44cd-a429-fa4d7a43c53a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:48.876375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4a1de-c910-44cd-a429-fa4d7a43c53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:48.876375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4a1de-c910-44cd-a429-fa4d7a43c53a admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:48.876375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4a1de-c910-44cd-a429-fa4d7a43c53a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:28:48.876375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4a1de-c910-44cd-a429-fa4d7a43c53a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:48.876375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4a1de-c910-44cd-a429-fa4d7a43c53a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:48.882757 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1418/2819] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:28:48.886911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb66ad0-ac04-4dee-96fc-ff59a644ee64 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:48.896760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb66ad0-ac04-4dee-96fc-ff59a644ee64 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:48.901348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e3fc-89ce-4060-a884-f04ac5a79df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:48.901992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e3fc-89ce-4060-a884-f04ac5a79df5 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:48.902273 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e3fc-89ce-4060-a884-f04ac5a79df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:48.902547 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e3fc-89ce-4060-a884-f04ac5a79df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:48.903272 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e3fc-89ce-4060-a884-f04ac5a79df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:48.905149 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e3fc-89ce-4060-a884-f04ac5a79df5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:48.981920 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1402/2820] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:28:48 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:48.986034 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4a1de-c910-44cd-a429-fa4d7a43c53a admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:48.996547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4a1de-c910-44cd-a429-fa4d7a43c53a admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:49.052512 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff36ae-1e70-4298-8345-27c2893644da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:49.053174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff36ae-1e70-4298-8345-27c2893644da admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.053459 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff36ae-1e70-4298-8345-27c2893644da admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.053737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff36ae-1e70-4298-8345-27c2893644da admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.054426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff36ae-1e70-4298-8345-27c2893644da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:49.056375 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff36ae-1e70-4298-8345-27c2893644da admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:49.135594 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1419/2821] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:28:48 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:49.139511 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e3fc-89ce-4060-a884-f04ac5a79df5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:49.149833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e3fc-89ce-4060-a884-f04ac5a79df5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:49.154462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e3430-de0f-40ee-91de-c772573bab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:49.155139 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e3430-de0f-40ee-91de-c772573bab08 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.155424 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e3430-de0f-40ee-91de-c772573bab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.155697 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e3430-de0f-40ee-91de-c772573bab08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.156414 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e3430-de0f-40ee-91de-c772573bab08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:49.157982 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e3430-de0f-40ee-91de-c772573bab08 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:49.168069 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1403/2822] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:28:49.171926 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff36ae-1e70-4298-8345-27c2893644da admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:49.182501 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff36ae-1e70-4298-8345-27c2893644da admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:49.187086 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692fa8b-52b4-4005-84a9-dab89ab66241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:49.187759 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692fa8b-52b4-4005-84a9-dab89ab66241 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.188044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692fa8b-52b4-4005-84a9-dab89ab66241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.188318 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692fa8b-52b4-4005-84a9-dab89ab66241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.189039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692fa8b-52b4-4005-84a9-dab89ab66241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:49.190596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692fa8b-52b4-4005-84a9-dab89ab66241 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:49.192485 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:49.201982 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1420/2823] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:28:49.205875 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e3430-de0f-40ee-91de-c772573bab08 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:49.215581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e3430-de0f-40ee-91de-c772573bab08 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:49.220130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a396c-cca8-41bb-96c3-17d447113947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:49.220995 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a396c-cca8-41bb-96c3-17d447113947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.221274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a396c-cca8-41bb-96c3-17d447113947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.221546 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a396c-cca8-41bb-96c3-17d447113947 admin admin] PATH_INFO: `/v3/projects/a2de9684da16491097e24cd24ddd6295/users/ba69633032564fa2b17d46cea5e4eab5/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.235960 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a396c-cca8-41bb-96c3-17d447113947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2de9684da16491097e24cd24ddd6295, user_id=ba69633032564fa2b17d46cea5e4eab5, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:49.239110 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a396c-cca8-41bb-96c3-17d447113947 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:49.312674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1404/2824] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:28:49 2022] PUT /identity/v3/projects/a2de9684da16491097e24cd24ddd6295/users/ba69633032564fa2b17d46cea5e4eab5/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:49.323730 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98776e1-cb4e-401e-8769-d54f6ac9249b None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.324046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98776e1-cb4e-401e-8769-d54f6ac9249b None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.324346 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98776e1-cb4e-401e-8769-d54f6ac9249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.350371 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a98776e1-cb4e-401e-8769-d54f6ac9249b None None] MFA Rules not processed for user `ba69633032564fa2b17d46cea5e4eab5`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:49.352044 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a98776e1-cb4e-401e-8769-d54f6ac9249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:49.416298 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1421/2825] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:49.420900 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a396c-cca8-41bb-96c3-17d447113947 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:49.480817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a396c-cca8-41bb-96c3-17d447113947 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:49.485405 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea009f-c145-47c2-9fa7-edb945b5060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:49.486048 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea009f-c145-47c2-9fa7-edb945b5060e admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.486328 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea009f-c145-47c2-9fa7-edb945b5060e admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.486603 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea009f-c145-47c2-9fa7-edb945b5060e admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.487318 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea009f-c145-47c2-9fa7-edb945b5060e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:49.489803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea009f-c145-47c2-9fa7-edb945b5060e admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:49.599814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1405/2826] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:28:49 2022] POST /identity/v3/projects => generated 393 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:49.603928 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98776e1-cb4e-401e-8769-d54f6ac9249b None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:49.615329 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98776e1-cb4e-401e-8769-d54f6ac9249b None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:49.669659 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f33ed-3355-41b5-90d1-ede5c3d0ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:49.670249 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f33ed-3355-41b5-90d1-ede5c3d0ec84 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.670534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f33ed-3355-41b5-90d1-ede5c3d0ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.670809 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f33ed-3355-41b5-90d1-ede5c3d0ec84 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.671522 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f33ed-3355-41b5-90d1-ede5c3d0ec84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:49.673442 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f33ed-3355-41b5-90d1-ede5c3d0ec84 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:49.758049 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1422/2827] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:28:49 2022] POST /identity/v3/users => generated 303 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:49.762059 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea009f-c145-47c2-9fa7-edb945b5060e admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:49.772836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea009f-c145-47c2-9fa7-edb945b5060e admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:49.777453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0cc93-28b9-4647-b3cd-4727df8340b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:49.778092 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0cc93-28b9-4647-b3cd-4727df8340b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.778381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0cc93-28b9-4647-b3cd-4727df8340b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.778688 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0cc93-28b9-4647-b3cd-4727df8340b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.779474 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0cc93-28b9-4647-b3cd-4727df8340b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:49.781098 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0cc93-28b9-4647-b3cd-4727df8340b5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:49.782345 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:49.792817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1406/2828] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:28:49.796580 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f33ed-3355-41b5-90d1-ede5c3d0ec84 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:49.806387 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f33ed-3355-41b5-90d1-ede5c3d0ec84 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:49.810858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3082aa-3bab-491b-af83-c1c9896fbe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:49.811767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3082aa-3bab-491b-af83-c1c9896fbe9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.812041 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3082aa-3bab-491b-af83-c1c9896fbe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.812311 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3082aa-3bab-491b-af83-c1c9896fbe9c admin admin] PATH_INFO: `/v3/projects/55d916d516f04a8b97d80d66c967684d/users/41f4bdc4e0fc4dca867fadc58d0c6dda/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.826603 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3082aa-3bab-491b-af83-c1c9896fbe9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d916d516f04a8b97d80d66c967684d, user_id=41f4bdc4e0fc4dca867fadc58d0c6dda, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:49.829365 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3082aa-3bab-491b-af83-c1c9896fbe9c admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:49.920748 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1423/2829] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:28:49 2022] PUT /identity/v3/projects/55d916d516f04a8b97d80d66c967684d/users/41f4bdc4e0fc4dca867fadc58d0c6dda/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:49.924573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0cc93-28b9-4647-b3cd-4727df8340b5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:49.934667 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0cc93-28b9-4647-b3cd-4727df8340b5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:49.991315 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f699004-3dbe-481d-aa33-f950400906fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:49.991975 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699004-3dbe-481d-aa33-f950400906fb admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:49.992260 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699004-3dbe-481d-aa33-f950400906fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:49.992533 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699004-3dbe-481d-aa33-f950400906fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:49.993249 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f699004-3dbe-481d-aa33-f950400906fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:49.994991 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f699004-3dbe-481d-aa33-f950400906fb admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:50.004576 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1407/2830] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:28:50.008639 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3082aa-3bab-491b-af83-c1c9896fbe9c admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:50.018711 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3082aa-3bab-491b-af83-c1c9896fbe9c admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:50.023675 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d466ca-5bf7-4395-922c-c0ec567b4d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:50.024541 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d466ca-5bf7-4395-922c-c0ec567b4d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:50.024820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d466ca-5bf7-4395-922c-c0ec567b4d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:50.025089 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d466ca-5bf7-4395-922c-c0ec567b4d87 admin admin] PATH_INFO: `/v3/projects/55d916d516f04a8b97d80d66c967684d/users/41f4bdc4e0fc4dca867fadc58d0c6dda/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:50.027019 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d466ca-5bf7-4395-922c-c0ec567b4d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d916d516f04a8b97d80d66c967684d, user_id=41f4bdc4e0fc4dca867fadc58d0c6dda, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:50.029653 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d466ca-5bf7-4395-922c-c0ec567b4d87 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:50.040134 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1424/2831] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:28:50 2022] PUT /identity/v3/projects/55d916d516f04a8b97d80d66c967684d/users/41f4bdc4e0fc4dca867fadc58d0c6dda/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:50.049825 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e3337-86f2-4868-96b4-1edceb23ea3b None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:50.050117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e3337-86f2-4868-96b4-1edceb23ea3b None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:50.050398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e3337-86f2-4868-96b4-1edceb23ea3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:50.076390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-482e3337-86f2-4868-96b4-1edceb23ea3b None None] MFA Rules not processed for user `41f4bdc4e0fc4dca867fadc58d0c6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:50.077660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-482e3337-86f2-4868-96b4-1edceb23ea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:50.153095 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1408/2832] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:50.163521 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d466ca-5bf7-4395-922c-c0ec567b4d87 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:50.165174 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f1d466ca-5bf7-4395-922c-c0ec567b4d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:50.208008 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:50.222746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d466ca-5bf7-4395-922c-c0ec567b4d87 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:50.226737 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ab15-62e2-4b8f-971d-bcd978f5d62c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:50.227408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ab15-62e2-4b8f-971d-bcd978f5d62c service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:50.227693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ab15-62e2-4b8f-971d-bcd978f5d62c service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:50.227966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ab15-62e2-4b8f-971d-bcd978f5d62c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:50.236981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22ab15-62e2-4b8f-971d-bcd978f5d62c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:50.238400 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22ab15-62e2-4b8f-971d-bcd978f5d62c service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:50.247784 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1425/2833] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:28:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:28:50.293618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e3337-86f2-4868-96b4-1edceb23ea3b None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:50.295002 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-482e3337-86f2-4868-96b4-1edceb23ea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:50.307084 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e3337-86f2-4868-96b4-1edceb23ea3b None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:50.310731 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ea25b-e976-4175-9f41-38b3da3baaa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:50.311399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ea25b-e976-4175-9f41-38b3da3baaa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:50.311682 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ea25b-e976-4175-9f41-38b3da3baaa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:50.311959 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ea25b-e976-4175-9f41-38b3da3baaa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:50.368836 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ea25b-e976-4175-9f41-38b3da3baaa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:50.370261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ea25b-e976-4175-9f41-38b3da3baaa4 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:50.379800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1409/2834] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:28:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:28:54.876903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ab15-62e2-4b8f-971d-bcd978f5d62c service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:54.937221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ab15-62e2-4b8f-971d-bcd978f5d62c service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:54.941672 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:54.942525 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:54.942868 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:54.943178 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] PATH_INFO: `/v3/users/ba69633032564fa2b17d46cea5e4eab5` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:54.944356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba69633032564fa2b17d46cea5e4eab5)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:54.946235 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:55.157940 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba69633032564fa2b17d46cea5e4eab5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:55.158540 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba69633032564fa2b17d46cea5e4eab5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:55.159215 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba69633032564fa2b17d46cea5e4eab5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:55.171721 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba69633032564fa2b17d46cea5e4eab5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:55.178768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba69633032564fa2b17d46cea5e4eab5'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:55.266788 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1426/2835] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:28:54 2022] DELETE /identity/v3/users/ba69633032564fa2b17d46cea5e4eab5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:55.272029 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366bcf8-3c51-49af-96a7-35dc3c26a498 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:55.272455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366bcf8-3c51-49af-96a7-35dc3c26a498 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:55.272687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366bcf8-3c51-49af-96a7-35dc3c26a498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:55.290302 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-c366bcf8-3c51-49af-96a7-35dc3c26a498 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:55.291538 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c366bcf8-3c51-49af-96a7-35dc3c26a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:55.300687 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=100 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:55.363019 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1410/2836] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:55.372622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:55.374099 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:55.431720 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f892f50-bdc7-483a-88ec-e391b5be50fe admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:55.435348 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42522a6-a2f2-4724-b5d0-b62eb5706d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:55.435999 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42522a6-a2f2-4724-b5d0-b62eb5706d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:55.436282 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42522a6-a2f2-4724-b5d0-b62eb5706d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:55.436557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42522a6-a2f2-4724-b5d0-b62eb5706d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:55.446148 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42522a6-a2f2-4724-b5d0-b62eb5706d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:55.447592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42522a6-a2f2-4724-b5d0-b62eb5706d0a service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:55.457547 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1427/2837] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:28:55.862261 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366bcf8-3c51-49af-96a7-35dc3c26a498 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:55.864421 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-c366bcf8-3c51-49af-96a7-35dc3c26a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:55.877172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366bcf8-3c51-49af-96a7-35dc3c26a498 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:55.882854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:55.883359 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:55.883585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:55.883858 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] PATH_INFO: `/v3/projects/a2de9684da16491097e24cd24ddd6295` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:55.885026 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2de9684da16491097e24cd24ddd6295)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:55.887783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:56.005720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2de9684da16491097e24cd24ddd6295', 'request_id': 'req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.011933 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2de9684da16491097e24cd24ddd6295', 'request_id': 'req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.117579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2de9684da16491097e24cd24ddd6295', 'request_id': 'req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.128473 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] The token cache is being invalidate because project a2de9684da16491097e24cd24ddd6295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:28:56.128760 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.129377 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.130922 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1411/2838] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:28:55 2022] DELETE /identity/v3/projects/a2de9684da16491097e24cd24ddd6295 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:56.134881 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42522a6-a2f2-4724-b5d0-b62eb5706d0a service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:56.139917 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:56.145257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42522a6-a2f2-4724-b5d0-b62eb5706d0a service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:56.199688 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:56.200555 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:56.200843 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:56.201112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] PATH_INFO: `/v3/users/41f4bdc4e0fc4dca867fadc58d0c6dda` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:56.202276 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f4bdc4e0fc4dca867fadc58d0c6dda)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:56.204191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:56.396264 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f4bdc4e0fc4dca867fadc58d0c6dda'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.397054 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f4bdc4e0fc4dca867fadc58d0c6dda'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.397986 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f4bdc4e0fc4dca867fadc58d0c6dda'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.411454 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f4bdc4e0fc4dca867fadc58d0c6dda'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.418320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-b58dbc21-7582-4319-bc98-749101693930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f4bdc4e0fc4dca867fadc58d0c6dda'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:56.517330 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1428/2839] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:28:56 2022] DELETE /identity/v3/users/41f4bdc4e0fc4dca867fadc58d0c6dda => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:56.910585 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:56.912176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:56.926833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d2aee-2fce-47e2-b2aa-bfdcf17cc6e3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:56.984880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:56.985738 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:56.986018 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:56.986291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] PATH_INFO: `/v3/projects/55d916d516f04a8b97d80d66c967684d` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:56.987671 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d916d516f04a8b97d80d66c967684d)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:56.989652 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:57.079952 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:57.086448 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d916d516f04a8b97d80d66c967684d', 'request_id': 'req-349c5526-386f-47ae-93a5-ccf35b473dd7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:57.092567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d916d516f04a8b97d80d66c967684d', 'request_id': 'req-349c5526-386f-47ae-93a5-ccf35b473dd7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:57.182979 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d916d516f04a8b97d80d66c967684d', 'request_id': 'req-349c5526-386f-47ae-93a5-ccf35b473dd7'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:57.194354 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] The token cache is being invalidate because project 55d916d516f04a8b97d80d66c967684d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:28:57.194641 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:57.195307 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-349c5526-386f-47ae-93a5-ccf35b473dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:28:57.196953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1412/2840] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:28:56 2022] DELETE /identity/v3/projects/55d916d516f04a8b97d80d66c967684d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:57.201840 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57973d-9989-4007-a191-99c79bcd5222 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:57.202320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57973d-9989-4007-a191-99c79bcd5222 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:57.202418 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57973d-9989-4007-a191-99c79bcd5222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:57.220257 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-8c57973d-9989-4007-a191-99c79bcd5222 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:57.221452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-8c57973d-9989-4007-a191-99c79bcd5222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:57.280977 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1429/2841] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:57.288923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376ee7-b2ce-4129-b418-b868b6d2f704 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:57.289208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376ee7-b2ce-4129-b418-b868b6d2f704 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:57.289484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376ee7-b2ce-4129-b418-b868b6d2f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:57.307847 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-b8376ee7-b2ce-4129-b418-b868b6d2f704 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:57.309038 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-b8376ee7-b2ce-4129-b418-b868b6d2f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:57.317503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1413/2842] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:57.321534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57973d-9989-4007-a191-99c79bcd5222 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:57.331367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57973d-9989-4007-a191-99c79bcd5222 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:57.335896 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54684-76fa-4339-aaeb-21ad52356667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:57.336542 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54684-76fa-4339-aaeb-21ad52356667 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:57.336825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54684-76fa-4339-aaeb-21ad52356667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:57.337097 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54684-76fa-4339-aaeb-21ad52356667 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:57.337815 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54684-76fa-4339-aaeb-21ad52356667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:28:57.338118 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54684-76fa-4339-aaeb-21ad52356667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:57.339789 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54684-76fa-4339-aaeb-21ad52356667 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:57.351648 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1430/2843] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:28:57.356390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8376ee7-b2ce-4129-b418-b868b6d2f704 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:57.365714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8376ee7-b2ce-4129-b418-b868b6d2f704 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:57.370433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db44c0c-81f1-424a-ba75-fffb7cbf9f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:57.371078 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db44c0c-81f1-424a-ba75-fffb7cbf9f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:57.371386 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db44c0c-81f1-424a-ba75-fffb7cbf9f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:57.371664 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db44c0c-81f1-424a-ba75-fffb7cbf9f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:57.372378 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db44c0c-81f1-424a-ba75-fffb7cbf9f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:57.374388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db44c0c-81f1-424a-ba75-fffb7cbf9f96 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:57.461963 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1414/2844] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:28:57 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:57.466112 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54684-76fa-4339-aaeb-21ad52356667 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:57.476234 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54684-76fa-4339-aaeb-21ad52356667 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:57.480782 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:57.531629 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb62ba-ac4a-4c18-b5c6-2190cb0fb03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:57.532439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb62ba-ac4a-4c18-b5c6-2190cb0fb03b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:57.533141 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb62ba-ac4a-4c18-b5c6-2190cb0fb03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:57.533408 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb62ba-ac4a-4c18-b5c6-2190cb0fb03b admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:57.534093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb62ba-ac4a-4c18-b5c6-2190cb0fb03b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:57.536353 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb62ba-ac4a-4c18-b5c6-2190cb0fb03b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:57.664312 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1431/2845] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:28:57 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:57.668333 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db44c0c-81f1-424a-ba75-fffb7cbf9f96 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:57.679141 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db44c0c-81f1-424a-ba75-fffb7cbf9f96 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:57.683549 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb4876-0adf-4102-9518-40acc6657dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:57.684206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb4876-0adf-4102-9518-40acc6657dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:57.684484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb4876-0adf-4102-9518-40acc6657dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:57.684756 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb4876-0adf-4102-9518-40acc6657dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:57.685501 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb4876-0adf-4102-9518-40acc6657dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:57.687065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb4876-0adf-4102-9518-40acc6657dc6 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:57.697717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1415/2846] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:28:57.701741 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb62ba-ac4a-4c18-b5c6-2190cb0fb03b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:57.711831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb62ba-ac4a-4c18-b5c6-2190cb0fb03b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:57.717181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88cb8e-415f-4cb6-b37c-baf0974c1f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:57.717181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88cb8e-415f-4cb6-b37c-baf0974c1f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:57.717548 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88cb8e-415f-4cb6-b37c-baf0974c1f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:57.717829 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88cb8e-415f-4cb6-b37c-baf0974c1f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:57.718552 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88cb8e-415f-4cb6-b37c-baf0974c1f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:57.720173 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88cb8e-415f-4cb6-b37c-baf0974c1f2a admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:57.730805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1432/2847] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:28:57.734790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb4876-0adf-4102-9518-40acc6657dc6 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:57.745255 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb4876-0adf-4102-9518-40acc6657dc6 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:57.749691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fc63b-c0f2-455a-b4fd-7463fbd2e01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:57.750554 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fc63b-c0f2-455a-b4fd-7463fbd2e01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:57.750827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fc63b-c0f2-455a-b4fd-7463fbd2e01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:57.751116 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fc63b-c0f2-455a-b4fd-7463fbd2e01a admin admin] PATH_INFO: `/v3/projects/9f173ceb94d347c0802e02fa4d97898c/users/9aca198d7f5d4c849210ab57ddb53ba4/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:57.765176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fc63b-c0f2-455a-b4fd-7463fbd2e01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f173ceb94d347c0802e02fa4d97898c, user_id=9aca198d7f5d4c849210ab57ddb53ba4, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:57.767820 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fc63b-c0f2-455a-b4fd-7463fbd2e01a admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:57.837600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1416/2848] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:28:57 2022] PUT /identity/v3/projects/9f173ceb94d347c0802e02fa4d97898c/users/9aca198d7f5d4c849210ab57ddb53ba4/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:57.852564 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301849f-8776-4500-a9e2-f3f624dbc6d3 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:57.852858 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301849f-8776-4500-a9e2-f3f624dbc6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:57.853138 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301849f-8776-4500-a9e2-f3f624dbc6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:57.880443 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-a301849f-8776-4500-a9e2-f3f624dbc6d3 None None] MFA Rules not processed for user `9aca198d7f5d4c849210ab57ddb53ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:57.881674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-a301849f-8776-4500-a9e2-f3f624dbc6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:57.946018 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1433/2849] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:57.950398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fc63b-c0f2-455a-b4fd-7463fbd2e01a admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:58.011216 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fc63b-c0f2-455a-b4fd-7463fbd2e01a admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:58.015815 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a87e5b-71b9-46b3-afe3-4d4ca7c61b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:58.016466 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a87e5b-71b9-46b3-afe3-4d4ca7c61b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:58.016746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a87e5b-71b9-46b3-afe3-4d4ca7c61b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:58.017021 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a87e5b-71b9-46b3-afe3-4d4ca7c61b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:58.017702 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a87e5b-71b9-46b3-afe3-4d4ca7c61b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:58.020096 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a87e5b-71b9-46b3-afe3-4d4ca7c61b28 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:58.136228 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1417/2850] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:28:57 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:58.140260 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301849f-8776-4500-a9e2-f3f624dbc6d3 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:58.151537 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301849f-8776-4500-a9e2-f3f624dbc6d3 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:58.206124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5db82a-18fd-4a9c-b0d7-da6291bf7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:58.207273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5db82a-18fd-4a9c-b0d7-da6291bf7fbf admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:58.207534 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5db82a-18fd-4a9c-b0d7-da6291bf7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:58.207813 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5db82a-18fd-4a9c-b0d7-da6291bf7fbf admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:58.208504 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5db82a-18fd-4a9c-b0d7-da6291bf7fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:58.210620 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5db82a-18fd-4a9c-b0d7-da6291bf7fbf admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:58.312300 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1434/2851] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:28:58 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:28:58.316192 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a87e5b-71b9-46b3-afe3-4d4ca7c61b28 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:58.326691 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a87e5b-71b9-46b3-afe3-4d4ca7c61b28 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:58.331803 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e279c2-1880-41aa-8ccd-a134bfba668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:58.332453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e279c2-1880-41aa-8ccd-a134bfba668c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:58.332735 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e279c2-1880-41aa-8ccd-a134bfba668c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:58.333004 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e279c2-1880-41aa-8ccd-a134bfba668c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:58.333717 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e279c2-1880-41aa-8ccd-a134bfba668c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:58.335311 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e279c2-1880-41aa-8ccd-a134bfba668c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:58.345614 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1418/2852] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:28:58.354478 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5db82a-18fd-4a9c-b0d7-da6291bf7fbf admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:58.360582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5db82a-18fd-4a9c-b0d7-da6291bf7fbf admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:58.365202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e885af-dd40-4fd6-a50f-3ccc355323dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:58.366078 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e885af-dd40-4fd6-a50f-3ccc355323dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:58.366359 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e885af-dd40-4fd6-a50f-3ccc355323dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:58.366636 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e885af-dd40-4fd6-a50f-3ccc355323dc admin admin] PATH_INFO: `/v3/projects/7462c39ce6ac44e588b98d0ebb841c9a/users/5c004919379346e8a6597c8065709b15/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:58.368979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:58.382374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e885af-dd40-4fd6-a50f-3ccc355323dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7462c39ce6ac44e588b98d0ebb841c9a, user_id=5c004919379346e8a6597c8065709b15, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:58.385055 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e885af-dd40-4fd6-a50f-3ccc355323dc admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:58.451953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1435/2853] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:28:58 2022] PUT /identity/v3/projects/7462c39ce6ac44e588b98d0ebb841c9a/users/5c004919379346e8a6597c8065709b15/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:58.455889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e279c2-1880-41aa-8ccd-a134bfba668c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:58.466441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e279c2-1880-41aa-8ccd-a134bfba668c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:58.503065 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:58.521176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c499379-12bc-46e7-8bd6-3ad1b1e56514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:58.521827 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499379-12bc-46e7-8bd6-3ad1b1e56514 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:58.522104 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499379-12bc-46e7-8bd6-3ad1b1e56514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:58.522630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499379-12bc-46e7-8bd6-3ad1b1e56514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:58.523138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c499379-12bc-46e7-8bd6-3ad1b1e56514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:58.524715 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c499379-12bc-46e7-8bd6-3ad1b1e56514 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:58.533992 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1419/2854] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:28:58.538228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e885af-dd40-4fd6-a50f-3ccc355323dc admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:58.548470 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e885af-dd40-4fd6-a50f-3ccc355323dc admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:58.553051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd5aae-bb31-4fa6-9bec-3e4ad1837c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:58.553921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd5aae-bb31-4fa6-9bec-3e4ad1837c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:58.554198 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd5aae-bb31-4fa6-9bec-3e4ad1837c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:58.554468 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd5aae-bb31-4fa6-9bec-3e4ad1837c24 admin admin] PATH_INFO: `/v3/projects/7462c39ce6ac44e588b98d0ebb841c9a/users/5c004919379346e8a6597c8065709b15/roles/a66072a83471483cacbe6d6ebd19ce3f` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:58.556489 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd5aae-bb31-4fa6-9bec-3e4ad1837c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7462c39ce6ac44e588b98d0ebb841c9a, user_id=5c004919379346e8a6597c8065709b15, role_id=a66072a83471483cacbe6d6ebd19ce3f)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:58.559064 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd5aae-bb31-4fa6-9bec-3e4ad1837c24 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:58.569751 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1436/2855] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:28:58 2022] PUT /identity/v3/projects/7462c39ce6ac44e588b98d0ebb841c9a/users/5c004919379346e8a6597c8065709b15/roles/a66072a83471483cacbe6d6ebd19ce3f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:28:58.630883 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a8360-edbb-4eed-beb3-d8379e25e59c None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:58.631208 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a8360-edbb-4eed-beb3-d8379e25e59c None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:58.631517 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a8360-edbb-4eed-beb3-d8379e25e59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:58.658439 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-3e9a8360-edbb-4eed-beb3-d8379e25e59c None None] MFA Rules not processed for user `5c004919379346e8a6597c8065709b15`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:28:58.659679 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3e9a8360-edbb-4eed-beb3-d8379e25e59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:58.726630 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1420/2856] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:28:58.737179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd5aae-bb31-4fa6-9bec-3e4ad1837c24 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:28:58.739516 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fdbd5aae-bb31-4fa6-9bec-3e4ad1837c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:28:58.795903 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd5aae-bb31-4fa6-9bec-3e4ad1837c24 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:28:58.799543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc2ab3-3d79-4778-bbe4-286964af21b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:28:58.800665 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc2ab3-3d79-4778-bbe4-286964af21b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:28:58.800944 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc2ab3-3d79-4778-bbe4-286964af21b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:28:58.801213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc2ab3-3d79-4778-bbe4-286964af21b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:28:58.856772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc2ab3-3d79-4778-bbe4-286964af21b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:28:58.858203 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc2ab3-3d79-4778-bbe4-286964af21b4 service cinder] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:28:58.867578 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1437/2857] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:28:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:29:03.954705 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a8360-edbb-4eed-beb3-d8379e25e59c None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:03.956130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3e9a8360-edbb-4eed-beb3-d8379e25e59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:03.968791 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a8360-edbb-4eed-beb3-d8379e25e59c None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:03.972388 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c904ccc-24bc-4588-a4ba-f193d09c1e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:03.973112 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c904ccc-24bc-4588-a4ba-f193d09c1e47 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:03.974899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c904ccc-24bc-4588-a4ba-f193d09c1e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:03.974899 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c904ccc-24bc-4588-a4ba-f193d09c1e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:03.982790 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c904ccc-24bc-4588-a4ba-f193d09c1e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:03.984259 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c904ccc-24bc-4588-a4ba-f193d09c1e47 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:03.994180 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1421/2858] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:29:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:29:08.863563 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=60,keystone:INSERT=2 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:09.696912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc2ab3-3d79-4778-bbe4-286964af21b4 service cinder] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:09.758101 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc2ab3-3d79-4778-bbe4-286964af21b4 service cinder] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:09.762502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:09.763396 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:09.763674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:09.763943 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] PATH_INFO: `/v3/users/9aca198d7f5d4c849210ab57ddb53ba4` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:09.765128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aca198d7f5d4c849210ab57ddb53ba4)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:09.767003 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:09.944880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aca198d7f5d4c849210ab57ddb53ba4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:09.945469 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aca198d7f5d4c849210ab57ddb53ba4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:09.946065 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aca198d7f5d4c849210ab57ddb53ba4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:09.957660 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aca198d7f5d4c849210ab57ddb53ba4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:09.964377 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aca198d7f5d4c849210ab57ddb53ba4'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:10.034128 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1438/2859] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:29:09 2022] DELETE /identity/v3/users/9aca198d7f5d4c849210ab57ddb53ba4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:10.038713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664c97-7cfb-473f-b1b8-7bcc93f3ee27 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:10.039233 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664c97-7cfb-473f-b1b8-7bcc93f3ee27 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:10.039348 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664c97-7cfb-473f-b1b8-7bcc93f3ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:10.057014 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-06664c97-7cfb-473f-b1b8-7bcc93f3ee27 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:10.058205 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-06664c97-7cfb-473f-b1b8-7bcc93f3ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:10.116931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1422/2860] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:10.126796 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:10.128228 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:10.186093 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6016d3f-d912-476b-b0aa-9b149ce63b48 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:10.190181 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13bb77-c84e-486d-bb69-6ea7dda0afba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:10.190831 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13bb77-c84e-486d-bb69-6ea7dda0afba service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:10.191139 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13bb77-c84e-486d-bb69-6ea7dda0afba service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:10.191423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13bb77-c84e-486d-bb69-6ea7dda0afba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:10.201508 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13bb77-c84e-486d-bb69-6ea7dda0afba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:10.202866 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13bb77-c84e-486d-bb69-6ea7dda0afba service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:10.212423 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1439/2861] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:29:10.599253 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664c97-7cfb-473f-b1b8-7bcc93f3ee27 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:10.601182 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-06664c97-7cfb-473f-b1b8-7bcc93f3ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:10.613195 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664c97-7cfb-473f-b1b8-7bcc93f3ee27 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:10.618425 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:10.619331 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:10.619610 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:10.619878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] PATH_INFO: `/v3/projects/9f173ceb94d347c0802e02fa4d97898c` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:10.621056 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f173ceb94d347c0802e02fa4d97898c)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:10.623063 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:10.754107 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:10.757604 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f173ceb94d347c0802e02fa4d97898c', 'request_id': 'req-9239e9e0-5925-4e0c-9505-ca25b0502499'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:10.763727 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f173ceb94d347c0802e02fa4d97898c', 'request_id': 'req-9239e9e0-5925-4e0c-9505-ca25b0502499'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:10.833923 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f173ceb94d347c0802e02fa4d97898c', 'request_id': 'req-9239e9e0-5925-4e0c-9505-ca25b0502499'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:10.844936 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] The token cache is being invalidate because project 9f173ceb94d347c0802e02fa4d97898c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:29:10.845427 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:10.846163 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:10.847977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1423/2862] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:29:10 2022] DELETE /identity/v3/projects/9f173ceb94d347c0802e02fa4d97898c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:10.852740 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13bb77-c84e-486d-bb69-6ea7dda0afba service neutron] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:10.862288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13bb77-c84e-486d-bb69-6ea7dda0afba service neutron] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:10.880191 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:10.917804 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:10.918674 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:10.918956 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:10.919266 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] PATH_INFO: `/v3/users/5c004919379346e8a6597c8065709b15` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:10.920439 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c004919379346e8a6597c8065709b15)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:10.922366 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:11.175912 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c004919379346e8a6597c8065709b15'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.176590 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c004919379346e8a6597c8065709b15'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.177132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c004919379346e8a6597c8065709b15'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.188706 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c004919379346e8a6597c8065709b15'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.196554 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-c747e2ab-deba-42f7-be59-a9848f0d42d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c004919379346e8a6597c8065709b15'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.283379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1440/2863] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:29:10 2022] DELETE /identity/v3/users/5c004919379346e8a6597c8065709b15 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:11.718946 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:11.725353 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:11.733861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239e9e0-5925-4e0c-9505-ca25b0502499 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:11.791248 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:11.792102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:11.792383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:11.792656 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] PATH_INFO: `/v3/projects/7462c39ce6ac44e588b98d0ebb841c9a` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:11.793878 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7462c39ce6ac44e588b98d0ebb841c9a)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:11.795833 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:11.894949 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7462c39ce6ac44e588b98d0ebb841c9a', 'request_id': 'req-3294a015-787a-4993-99a1-66c15b4c85dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.901175 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7462c39ce6ac44e588b98d0ebb841c9a', 'request_id': 'req-3294a015-787a-4993-99a1-66c15b4c85dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.969123 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7462c39ce6ac44e588b98d0ebb841c9a', 'request_id': 'req-3294a015-787a-4993-99a1-66c15b4c85dd'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.980713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] The token cache is being invalidate because project 7462c39ce6ac44e588b98d0ebb841c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:29:11.980942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.981695 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-3294a015-787a-4993-99a1-66c15b4c85dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:11.983274 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1424/2864] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:29:11 2022] DELETE /identity/v3/projects/7462c39ce6ac44e588b98d0ebb841c9a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:11.989268 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff32c8-14c5-41b8-99ec-4d87ebb568d4 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:11.994506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff32c8-14c5-41b8-99ec-4d87ebb568d4 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:11.994506 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff32c8-14c5-41b8-99ec-4d87ebb568d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.010035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-e6ff32c8-14c5-41b8-99ec-4d87ebb568d4 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:12.011358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e6ff32c8-14c5-41b8-99ec-4d87ebb568d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:12.069142 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1441/2865] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:12.077400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1185f-60f2-40bd-a010-4805d01952d6 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:12.077719 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1185f-60f2-40bd-a010-4805d01952d6 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:12.077997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1185f-60f2-40bd-a010-4805d01952d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.096172 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-93d1185f-60f2-40bd-a010-4805d01952d6 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:12.097368 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-93d1185f-60f2-40bd-a010-4805d01952d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:12.105903 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1425/2866] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:12.110095 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff32c8-14c5-41b8-99ec-4d87ebb568d4 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:12.120399 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff32c8-14c5-41b8-99ec-4d87ebb568d4 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:12.125060 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1768e3-fe88-4fb8-b03b-a871e6d85d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:12.125714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1768e3-fe88-4fb8-b03b-a871e6d85d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:12.125998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1768e3-fe88-4fb8-b03b-a871e6d85d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:12.126273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1768e3-fe88-4fb8-b03b-a871e6d85d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.127024 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1768e3-fe88-4fb8-b03b-a871e6d85d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:29:12.127362 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1768e3-fe88-4fb8-b03b-a871e6d85d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:12.128953 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1768e3-fe88-4fb8-b03b-a871e6d85d39 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:12.140435 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1442/2867] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:29:12.144631 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1185f-60f2-40bd-a010-4805d01952d6 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:12.154232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1185f-60f2-40bd-a010-4805d01952d6 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:12.158817 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56090bcb-4e1e-47f2-b0de-1638d7f4c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:12.159494 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56090bcb-4e1e-47f2-b0de-1638d7f4c7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:12.159779 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56090bcb-4e1e-47f2-b0de-1638d7f4c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:12.160054 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56090bcb-4e1e-47f2-b0de-1638d7f4c7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.160746 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56090bcb-4e1e-47f2-b0de-1638d7f4c7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:12.163313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56090bcb-4e1e-47f2-b0de-1638d7f4c7b9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:12.244103 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1426/2868] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:29:12 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:29:12.248046 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1768e3-fe88-4fb8-b03b-a871e6d85d39 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:12.258202 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1768e3-fe88-4fb8-b03b-a871e6d85d39 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:12.284483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:12.315327 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbf47-b56a-49bc-99ee-35eb3a0e454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:12.315998 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbf47-b56a-49bc-99ee-35eb3a0e454d admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:12.316275 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbf47-b56a-49bc-99ee-35eb3a0e454d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:12.316561 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbf47-b56a-49bc-99ee-35eb3a0e454d admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.317233 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbf47-b56a-49bc-99ee-35eb3a0e454d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:12.319206 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbf47-b56a-49bc-99ee-35eb3a0e454d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:12.437691 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1443/2869] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:29:12 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:29:12.441814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56090bcb-4e1e-47f2-b0de-1638d7f4c7b9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:12.451914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56090bcb-4e1e-47f2-b0de-1638d7f4c7b9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:12.456379 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963e1e8-80bd-4261-b963-b8b624ed411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:12.457050 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963e1e8-80bd-4261-b963-b8b624ed411c admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:12.457326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963e1e8-80bd-4261-b963-b8b624ed411c admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:12.457595 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963e1e8-80bd-4261-b963-b8b624ed411c admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.458308 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963e1e8-80bd-4261-b963-b8b624ed411c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:12.460408 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963e1e8-80bd-4261-b963-b8b624ed411c admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:12.470422 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1427/2870] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:29:12.474361 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbf47-b56a-49bc-99ee-35eb3a0e454d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:12.484941 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbf47-b56a-49bc-99ee-35eb3a0e454d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:12.489627 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4511aa-2a86-491c-a4c1-60c08dd70922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:12.490273 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4511aa-2a86-491c-a4c1-60c08dd70922 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:12.490557 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4511aa-2a86-491c-a4c1-60c08dd70922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:12.490857 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4511aa-2a86-491c-a4c1-60c08dd70922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.491608 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4511aa-2a86-491c-a4c1-60c08dd70922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:12.493251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4511aa-2a86-491c-a4c1-60c08dd70922 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:12.503746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1444/2871] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:29:12.507732 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963e1e8-80bd-4261-b963-b8b624ed411c admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:12.517268 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963e1e8-80bd-4261-b963-b8b624ed411c admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:12.522143 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc14878-0444-45a9-9d87-3a3cb147667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:12.523044 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc14878-0444-45a9-9d87-3a3cb147667f admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:12.523342 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc14878-0444-45a9-9d87-3a3cb147667f admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:12.523608 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc14878-0444-45a9-9d87-3a3cb147667f admin admin] PATH_INFO: `/v3/projects/72c7df4c925344ed984d6ea6cb9b18c1/users/7d026ce418344e2bb72356dd447dbd52/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.538254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc14878-0444-45a9-9d87-3a3cb147667f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c7df4c925344ed984d6ea6cb9b18c1, user_id=7d026ce418344e2bb72356dd447dbd52, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:12.540870 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc14878-0444-45a9-9d87-3a3cb147667f admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:12.632858 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:12.638390 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1428/2872] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:29:12 2022] PUT /identity/v3/projects/72c7df4c925344ed984d6ea6cb9b18c1/users/7d026ce418344e2bb72356dd447dbd52/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:29:12.650147 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299037e-78f6-4c79-8d0a-93db87a6ef07 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:12.650431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299037e-78f6-4c79-8d0a-93db87a6ef07 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:12.650710 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299037e-78f6-4c79-8d0a-93db87a6ef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.676596 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6299037e-78f6-4c79-8d0a-93db87a6ef07 None None] MFA Rules not processed for user `7d026ce418344e2bb72356dd447dbd52`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:12.677806 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6299037e-78f6-4c79-8d0a-93db87a6ef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:12.742655 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1445/2873] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:12.753957 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc14878-0444-45a9-9d87-3a3cb147667f admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:12.755621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-4fc14878-0444-45a9-9d87-3a3cb147667f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:12.811690 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc14878-0444-45a9-9d87-3a3cb147667f admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:12.815461 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb756ab-16d0-434d-8fa4-f97b29ca3779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:12.816087 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb756ab-16d0-434d-8fa4-f97b29ca3779 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:12.816363 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb756ab-16d0-434d-8fa4-f97b29ca3779 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:12.816637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb756ab-16d0-434d-8fa4-f97b29ca3779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:12.825238 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb756ab-16d0-434d-8fa4-f97b29ca3779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:12.826637 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb756ab-16d0-434d-8fa4-f97b29ca3779 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:12.835805 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1429/2874] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:29:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:29:15.835920 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299037e-78f6-4c79-8d0a-93db87a6ef07 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:15.895462 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299037e-78f6-4c79-8d0a-93db87a6ef07 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:15.900513 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:15.901374 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:15.901654 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:15.901925 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] PATH_INFO: `/v3/users/7d026ce418344e2bb72356dd447dbd52` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:15.903088 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d026ce418344e2bb72356dd447dbd52)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:15.905070 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:16.085080 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:16.090690 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d026ce418344e2bb72356dd447dbd52'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.092038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d026ce418344e2bb72356dd447dbd52'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.092038 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d026ce418344e2bb72356dd447dbd52'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.103872 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d026ce418344e2bb72356dd447dbd52'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.110609 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d026ce418344e2bb72356dd447dbd52'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.197431 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1446/2875] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:29:15 2022] DELETE /identity/v3/users/7d026ce418344e2bb72356dd447dbd52 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:16.201971 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14c6c8-7689-4cf6-bd94-bcd340b904e9 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:16.202485 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14c6c8-7689-4cf6-bd94-bcd340b904e9 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:16.202600 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14c6c8-7689-4cf6-bd94-bcd340b904e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:16.219441 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-5e14c6c8-7689-4cf6-bd94-bcd340b904e9 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:16.220629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e14c6c8-7689-4cf6-bd94-bcd340b904e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:16.280130 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1430/2876] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:16.290221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:16.291768 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:16.347678 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c12f07-488b-4337-8449-01beaea2506f admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:16.352357 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d22f9e-2741-4013-9ae0-c30c1c8d684f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:16.353949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d22f9e-2741-4013-9ae0-c30c1c8d684f service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:16.353949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d22f9e-2741-4013-9ae0-c30c1c8d684f service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:16.353949 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d22f9e-2741-4013-9ae0-c30c1c8d684f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:16.362722 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d22f9e-2741-4013-9ae0-c30c1c8d684f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:16.364162 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d22f9e-2741-4013-9ae0-c30c1c8d684f service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:16.373981 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1447/2877] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:29:16.793206 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14c6c8-7689-4cf6-bd94-bcd340b904e9 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:16.794669 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5e14c6c8-7689-4cf6-bd94-bcd340b904e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:16.806709 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14c6c8-7689-4cf6-bd94-bcd340b904e9 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:16.811453 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:16.812288 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:16.812567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:16.812846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] PATH_INFO: `/v3/projects/72c7df4c925344ed984d6ea6cb9b18c1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:16.814066 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c7df4c925344ed984d6ea6cb9b18c1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:16.816007 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:16.906246 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c7df4c925344ed984d6ea6cb9b18c1', 'request_id': 'req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.912970 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c7df4c925344ed984d6ea6cb9b18c1', 'request_id': 'req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.982873 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c7df4c925344ed984d6ea6cb9b18c1', 'request_id': 'req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.993624 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] The token cache is being invalidate because project 72c7df4c925344ed984d6ea6cb9b18c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:29:16.993914 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.994541 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-0637ac7d-9dee-4671-bde6-ddaa6f52fbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:16.996105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1431/2878] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:29:16 2022] DELETE /identity/v3/projects/72c7df4c925344ed984d6ea6cb9b18c1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:17.001321 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c29e-5f21-4a81-b277-8e505a9431d9 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.002022 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c29e-5f21-4a81-b277-8e505a9431d9 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.002301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c29e-5f21-4a81-b277-8e505a9431d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.020213 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f3b5c29e-5f21-4a81-b277-8e505a9431d9 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:17.021921 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f3b5c29e-5f21-4a81-b277-8e505a9431d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:17.078992 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1448/2879] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:17.088276 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd8f53-515f-42a2-88b5-c3a4a4aacc84 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.088567 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd8f53-515f-42a2-88b5-c3a4a4aacc84 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.088846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd8f53-515f-42a2-88b5-c3a4a4aacc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.107623 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-73fd8f53-515f-42a2-88b5-c3a4a4aacc84 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:17.108829 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-73fd8f53-515f-42a2-88b5-c3a4a4aacc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:17.116729 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1432/2880] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:17.121023 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5c29e-5f21-4a81-b277-8e505a9431d9 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:17.130622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5c29e-5f21-4a81-b277-8e505a9431d9 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:17.135657 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233148ec-c2e7-409b-9a0d-c6d7f088310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:17.136301 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233148ec-c2e7-409b-9a0d-c6d7f088310d admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.136581 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233148ec-c2e7-409b-9a0d-c6d7f088310d admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.136855 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233148ec-c2e7-409b-9a0d-c6d7f088310d admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.137568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233148ec-c2e7-409b-9a0d-c6d7f088310d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:29:17.137871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233148ec-c2e7-409b-9a0d-c6d7f088310d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:17.139483 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233148ec-c2e7-409b-9a0d-c6d7f088310d admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:17.151356 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1449/2881] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:29:17.155454 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd8f53-515f-42a2-88b5-c3a4a4aacc84 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:17.165049 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd8f53-515f-42a2-88b5-c3a4a4aacc84 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:17.169629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74d921-3441-4660-be2e-58184f0aa7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:17.170277 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74d921-3441-4660-be2e-58184f0aa7da admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.170561 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74d921-3441-4660-be2e-58184f0aa7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.170838 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74d921-3441-4660-be2e-58184f0aa7da admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.171560 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74d921-3441-4660-be2e-58184f0aa7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:17.173472 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74d921-3441-4660-be2e-58184f0aa7da admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:17.187105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:17.298698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1433/2882] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:29:17 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:29:17.303051 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233148ec-c2e7-409b-9a0d-c6d7f088310d admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:17.313124 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233148ec-c2e7-409b-9a0d-c6d7f088310d admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:17.356689 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:17.368884 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ea1b-6a51-44c1-9a94-a055a12faa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:17.369546 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ea1b-6a51-44c1-9a94-a055a12faa22 admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.369827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ea1b-6a51-44c1-9a94-a055a12faa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.370096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ea1b-6a51-44c1-9a94-a055a12faa22 admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.370786 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ea1b-6a51-44c1-9a94-a055a12faa22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:17.372708 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ea1b-6a51-44c1-9a94-a055a12faa22 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:17.485704 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1450/2883] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:29:17 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:29:17.489800 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74d921-3441-4660-be2e-58184f0aa7da admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:17.500556 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74d921-3441-4660-be2e-58184f0aa7da admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:17.506764 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aba3a-7e21-466e-a4f2-e6273196b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:17.507443 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aba3a-7e21-466e-a4f2-e6273196b245 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.507728 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aba3a-7e21-466e-a4f2-e6273196b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.508005 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aba3a-7e21-466e-a4f2-e6273196b245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.508720 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272aba3a-7e21-466e-a4f2-e6273196b245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:17.510303 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272aba3a-7e21-466e-a4f2-e6273196b245 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:17.520593 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1434/2884] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:29:17.524458 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ea1b-6a51-44c1-9a94-a055a12faa22 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:17.534199 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ea1b-6a51-44c1-9a94-a055a12faa22 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:17.538641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd93cc0-1799-4f8b-8a12-1554af3c46d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:17.539319 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd93cc0-1799-4f8b-8a12-1554af3c46d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.539623 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd93cc0-1799-4f8b-8a12-1554af3c46d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.539871 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd93cc0-1799-4f8b-8a12-1554af3c46d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.540582 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd93cc0-1799-4f8b-8a12-1554af3c46d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:17.542140 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd93cc0-1799-4f8b-8a12-1554af3c46d2 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:17.552251 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1451/2885] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:29:17.557776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aba3a-7e21-466e-a4f2-e6273196b245 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:17.567665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aba3a-7e21-466e-a4f2-e6273196b245 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:17.572974 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f6b3-2bda-426b-b6a4-497cf42349b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:17.573846 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f6b3-2bda-426b-b6a4-497cf42349b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.574128 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f6b3-2bda-426b-b6a4-497cf42349b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.574403 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f6b3-2bda-426b-b6a4-497cf42349b3 admin admin] PATH_INFO: `/v3/projects/be9cd89b5364417a8194e8fd1ec22146/users/a49449726ce14c8f8c2c18b5fd52bcdc/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.589816 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061f6b3-2bda-426b-b6a4-497cf42349b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9cd89b5364417a8194e8fd1ec22146, user_id=a49449726ce14c8f8c2c18b5fd52bcdc, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:17.592478 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061f6b3-2bda-426b-b6a4-497cf42349b3 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:17.688955 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1435/2886] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:29:17 2022] PUT /identity/v3/projects/be9cd89b5364417a8194e8fd1ec22146/users/a49449726ce14c8f8c2c18b5fd52bcdc/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:17.699772 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f117-cd29-4922-89ae-6c40aa21104f None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.700059 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f117-cd29-4922-89ae-6c40aa21104f None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.700332 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f117-cd29-4922-89ae-6c40aa21104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.726177 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-b6b7f117-cd29-4922-89ae-6c40aa21104f None None] MFA Rules not processed for user `a49449726ce14c8f8c2c18b5fd52bcdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:17.727495 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-b6b7f117-cd29-4922-89ae-6c40aa21104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:17.790061 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1452/2887] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:17.801232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f6b3-2bda-426b-b6a4-497cf42349b3 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:17.803573 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-5061f6b3-2bda-426b-b6a4-497cf42349b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:17.859674 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f6b3-2bda-426b-b6a4-497cf42349b3 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:17.863392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f0f8e-783e-4a29-b95a-34db37588249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:17.864030 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0f8e-783e-4a29-b95a-34db37588249 service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.864310 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0f8e-783e-4a29-b95a-34db37588249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.864624 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0f8e-783e-4a29-b95a-34db37588249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.873483 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f0f8e-783e-4a29-b95a-34db37588249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:17.874893 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f0f8e-783e-4a29-b95a-34db37588249 service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:17.883578 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1436/2888] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:29:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:29:17.906876 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7f117-cd29-4922-89ae-6c40aa21104f None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:17.967114 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7f117-cd29-4922-89ae-6c40aa21104f None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:17.971559 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:17.972415 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:17.972693 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:17.972963 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] PATH_INFO: `/v3/users/a49449726ce14c8f8c2c18b5fd52bcdc` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:17.974883 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49449726ce14c8f8c2c18b5fd52bcdc)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:17.976810 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:18.198820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49449726ce14c8f8c2c18b5fd52bcdc'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:18.199502 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49449726ce14c8f8c2c18b5fd52bcdc'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:18.200108 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49449726ce14c8f8c2c18b5fd52bcdc'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:18.207338 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:18.213074 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49449726ce14c8f8c2c18b5fd52bcdc'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:18.219709 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49449726ce14c8f8c2c18b5fd52bcdc'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:18.305622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1453/2889] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:29:17 2022] DELETE /identity/v3/users/a49449726ce14c8f8c2c18b5fd52bcdc => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:18.310117 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acf169-a033-4b5a-b23e-f5e8956dec00 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:18.310640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acf169-a033-4b5a-b23e-f5e8956dec00 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:18.310640 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acf169-a033-4b5a-b23e-f5e8956dec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:18.327187 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-52acf169-a033-4b5a-b23e-f5e8956dec00 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:18.328363 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-52acf169-a033-4b5a-b23e-f5e8956dec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:18.385426 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1437/2890] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:18.394849 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:18.396714 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:18.453292 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7020eb-7dfc-40b1-a000-9dc7bf6632e4 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:18.456820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa322828-2d06-4cd3-9d17-0c452038d5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:18.457464 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa322828-2d06-4cd3-9d17-0c452038d5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:18.457745 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa322828-2d06-4cd3-9d17-0c452038d5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:18.458021 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa322828-2d06-4cd3-9d17-0c452038d5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:18.467592 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa322828-2d06-4cd3-9d17-0c452038d5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:18.472476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa322828-2d06-4cd3-9d17-0c452038d5c7 service neutron] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:18.479379 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1454/2891] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:29:18.868977 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acf169-a033-4b5a-b23e-f5e8956dec00 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:18.870399 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-52acf169-a033-4b5a-b23e-f5e8956dec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:18.883889 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acf169-a033-4b5a-b23e-f5e8956dec00 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:18.888611 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:18.889462 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:18.889740 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:18.890013 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] PATH_INFO: `/v3/projects/be9cd89b5364417a8194e8fd1ec22146` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:18.891235 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9cd89b5364417a8194e8fd1ec22146)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:18.893094 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:18.994880 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9cd89b5364417a8194e8fd1ec22146', 'request_id': 'req-f47cbdd8-77f2-44d6-9f1e-37f27df24570'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:19.000928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9cd89b5364417a8194e8fd1ec22146', 'request_id': 'req-f47cbdd8-77f2-44d6-9f1e-37f27df24570'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:19.004484 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:19.051433 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9cd89b5364417a8194e8fd1ec22146', 'request_id': 'req-f47cbdd8-77f2-44d6-9f1e-37f27df24570'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:19.062383 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] The token cache is being invalidate because project be9cd89b5364417a8194e8fd1ec22146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:29:19.062852 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:19.063927 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-f47cbdd8-77f2-44d6-9f1e-37f27df24570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:29:19.067590 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1438/2892] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:29:18 2022] DELETE /identity/v3/projects/be9cd89b5364417a8194e8fd1ec22146 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:19.071406 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e9f2-ff7e-43b3-ac11-865f33eefc28 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.071699 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e9f2-ff7e-43b3-ac11-865f33eefc28 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.071978 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e9f2-ff7e-43b3-ac11-865f33eefc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.089096 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-f2a3e9f2-ff7e-43b3-ac11-865f33eefc28 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:19.090288 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-f2a3e9f2-ff7e-43b3-ac11-865f33eefc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:19.148344 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1455/2893] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:19.155931 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65272063-598e-4bbb-8f66-638399eadcdf None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.156218 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65272063-598e-4bbb-8f66-638399eadcdf None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.156493 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65272063-598e-4bbb-8f66-638399eadcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.174528 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-65272063-598e-4bbb-8f66-638399eadcdf None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:19.175754 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-65272063-598e-4bbb-8f66-638399eadcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:19.184381 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1439/2894] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:19.188333 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e9f2-ff7e-43b3-ac11-865f33eefc28 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:19.198681 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e9f2-ff7e-43b3-ac11-865f33eefc28 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:19.203221 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327690-c9f3-440f-b08b-7c735cd9a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:19.203869 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327690-c9f3-440f-b08b-7c735cd9a2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.204146 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327690-c9f3-440f-b08b-7c735cd9a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.204417 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327690-c9f3-440f-b08b-7c735cd9a2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.205132 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327690-c9f3-440f-b08b-7c735cd9a2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:29:19.205436 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327690-c9f3-440f-b08b-7c735cd9a2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:19.207004 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327690-c9f3-440f-b08b-7c735cd9a2e7 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:19.218187 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1456/2895] 10.222.0.13 () {58 vars in 1152 bytes} [Thu Jun 2 10:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:29:19.222468 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65272063-598e-4bbb-8f66-638399eadcdf None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:19.232290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65272063-598e-4bbb-8f66-638399eadcdf None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:19.236942 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390978a3-890c-46aa-a34c-1e131a9901ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:19.237579 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390978a3-890c-46aa-a34c-1e131a9901ce admin admin] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.237862 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390978a3-890c-46aa-a34c-1e131a9901ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.238136 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390978a3-890c-46aa-a34c-1e131a9901ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.238818 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390978a3-890c-46aa-a34c-1e131a9901ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:19.241477 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390978a3-890c-46aa-a34c-1e131a9901ce admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:19.330953 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1440/2896] 10.222.0.13 () {60 vars in 1152 bytes} [Thu Jun 2 10:29:19 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:29:19.334820 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327690-c9f3-440f-b08b-7c735cd9a2e7 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:19.344666 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327690-c9f3-440f-b08b-7c735cd9a2e7 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:19.400180 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955640-48b5-4158-9923-e8f8ef6d4d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:19.408035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955640-48b5-4158-9923-e8f8ef6d4d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.408035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955640-48b5-4158-9923-e8f8ef6d4d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.408035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955640-48b5-4158-9923-e8f8ef6d4d9b admin admin] PATH_INFO: `/v3/users` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.408035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5955640-48b5-4158-9923-e8f8ef6d4d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:19.408035 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5955640-48b5-4158-9923-e8f8ef6d4d9b admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:19.413197 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:19.499759 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1457/2897] 10.222.0.13 () {60 vars in 1143 bytes} [Thu Jun 2 10:29:19 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:29:19.504290 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390978a3-890c-46aa-a34c-1e131a9901ce admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:19.514928 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390978a3-890c-46aa-a34c-1e131a9901ce admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:19.519535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216e733-3565-438a-96e6-07b4b308ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:19.521313 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216e733-3565-438a-96e6-07b4b308ec74 admin admin] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.521515 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216e733-3565-438a-96e6-07b4b308ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.521841 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216e733-3565-438a-96e6-07b4b308ec74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.522565 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216e733-3565-438a-96e6-07b4b308ec74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:19.524176 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216e733-3565-438a-96e6-07b4b308ec74 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:19.534393 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1441/2898] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:29:19.538647 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955640-48b5-4158-9923-e8f8ef6d4d9b admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:19.548615 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955640-48b5-4158-9923-e8f8ef6d4d9b admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:19.554179 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272bdd8-79fc-42dd-9f27-3c78ed5de090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:19.554827 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272bdd8-79fc-42dd-9f27-3c78ed5de090 admin admin] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.555137 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272bdd8-79fc-42dd-9f27-3c78ed5de090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.555480 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272bdd8-79fc-42dd-9f27-3c78ed5de090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.556195 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272bdd8-79fc-42dd-9f27-3c78ed5de090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:19.557767 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272bdd8-79fc-42dd-9f27-3c78ed5de090 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:19.567500 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1458/2899] 10.222.0.13 () {58 vars in 1121 bytes} [Thu Jun 2 10:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:29:19.571398 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216e733-3565-438a-96e6-07b4b308ec74 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:19.581137 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216e733-3565-438a-96e6-07b4b308ec74 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:19.585668 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8279f-d39c-47b4-807d-cd9634261ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:19.586526 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8279f-d39c-47b4-807d-cd9634261ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.586807 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8279f-d39c-47b4-807d-cd9634261ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.587077 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8279f-d39c-47b4-807d-cd9634261ec5 admin admin] PATH_INFO: `/v3/projects/736e2ca9b4c0467bb1a424fa187f05fc/users/b9fc9578e2ca4c9da1724ad0a22eedb1/roles/e9661633951e4db5a9b85f9a3bdfe777` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.601997 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8279f-d39c-47b4-807d-cd9634261ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736e2ca9b4c0467bb1a424fa187f05fc, user_id=b9fc9578e2ca4c9da1724ad0a22eedb1, role_id=e9661633951e4db5a9b85f9a3bdfe777)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:19.604629 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8279f-d39c-47b4-807d-cd9634261ec5 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:19.662725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1442/2900] 10.222.0.13 () {60 vars in 1482 bytes} [Thu Jun 2 10:29:19 2022] PUT /identity/v3/projects/736e2ca9b4c0467bb1a424fa187f05fc/users/b9fc9578e2ca4c9da1724ad0a22eedb1/roles/e9661633951e4db5a9b85f9a3bdfe777 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:29:19.668923 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e96ae-b54d-4c38-b5b1-bee10d4540b7 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.669214 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e96ae-b54d-4c38-b5b1-bee10d4540b7 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.669490 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e96ae-b54d-4c38-b5b1-bee10d4540b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.686902 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-660e96ae-b54d-4c38-b5b1-bee10d4540b7 None None] MFA Rules not processed for user `8ee8c41befe5418c95bad9a434d99f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:19.688125 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-660e96ae-b54d-4c38-b5b1-bee10d4540b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:19.744668 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1459/2901] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:19.754123 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8279f-d39c-47b4-807d-cd9634261ec5 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:19.755822 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ecf8279f-d39c-47b4-807d-cd9634261ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:19.812871 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8279f-d39c-47b4-807d-cd9634261ec5 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:19.816581 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64dea-0434-4eae-b8f1-8bb2e6ea21c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:19.817221 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64dea-0434-4eae-b8f1-8bb2e6ea21c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:19.817503 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64dea-0434-4eae-b8f1-8bb2e6ea21c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:19.817777 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64dea-0434-4eae-b8f1-8bb2e6ea21c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:19.826835 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad64dea-0434-4eae-b8f1-8bb2e6ea21c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:19.828291 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad64dea-0434-4eae-b8f1-8bb2e6ea21c9 service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:19.838400 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1443/2902] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:29:21.007673 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e19d3-c06d-42c0-a277-e0e8949a4b77 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:21.008219 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e19d3-c06d-42c0-a277-e0e8949a4b77 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:21.008334 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e19d3-c06d-42c0-a277-e0e8949a4b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:21.035979 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-257e19d3-c06d-42c0-a277-e0e8949a4b77 None None] MFA Rules not processed for user `b9fc9578e2ca4c9da1724ad0a22eedb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:21.037825 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-257e19d3-c06d-42c0-a277-e0e8949a4b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:21.102738 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1460/2903] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:21.113582 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64dea-0434-4eae-b8f1-8bb2e6ea21c9 service neutron] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:21.115618 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-6ad64dea-0434-4eae-b8f1-8bb2e6ea21c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:21.170926 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64dea-0434-4eae-b8f1-8bb2e6ea21c9 service neutron] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:21.174455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdcf92-a4d9-4bee-9e22-07ca6e85eeee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75463d1b7714510b3898b7fe05baf50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:21.175083 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdcf92-a4d9-4bee-9e22-07ca6e85eeee service cinder] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:21.175389 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdcf92-a4d9-4bee-9e22-07ca6e85eeee service cinder] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:21.175665 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdcf92-a4d9-4bee-9e22-07ca6e85eeee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:21.183911 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdcf92-a4d9-4bee-9e22-07ca6e85eeee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:21.185326 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdcf92-a4d9-4bee-9e22-07ca6e85eeee service cinder] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:21.194009 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1444/2904] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:29:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:29:22.871143 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0f58-6d4d-4ad2-83f3-11c2984e3408 None None] REQUEST_METHOD: `POST` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:22.871643 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0f58-6d4d-4ad2-83f3-11c2984e3408 None None] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:22.871746 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0f58-6d4d-4ad2-83f3-11c2984e3408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:22.888910 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.auth.core [None req-6cfc0f58-6d4d-4ad2-83f3-11c2984e3408 None None] MFA Rules not processed for user `b9fc9578e2ca4c9da1724ad0a22eedb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:29:22.890161 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6cfc0f58-6d4d-4ad2-83f3-11c2984e3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:22.898094 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1461/2905] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:29:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:29:28.035239 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdcf92-a4d9-4bee-9e22-07ca6e85eeee service cinder] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:29:28.036698 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-3dfdcf92-a4d9-4bee-9e22-07ca6e85eeee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:28.048714 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdcf92-a4d9-4bee-9e22-07ca6e85eeee service cinder] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:29:28.052774 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce7717-f52f-42f8-8694-8f5584041b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bc0ef455caa4ee5b6b86dc1904d4e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:29:28.053516 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce7717-f52f-42f8-8694-8f5584041b9d service neutron] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:29:28.053799 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce7717-f52f-42f8-8694-8f5584041b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:29:28.054076 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce7717-f52f-42f8-8694-8f5584041b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:29:28.055853 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-f0ce7717-f52f-42f8-8694-8f5584041b9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:29:28.065369 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce7717-f52f-42f8-8694-8f5584041b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:29:28.066776 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce7717-f52f-42f8-8694-8f5584041b9d service neutron] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:29:28.075848 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1445/2906] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:29:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:29:32.883811 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:INSERT=1,keystone:SELECT=69 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:38.072138 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=89,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:29.523707 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc0f58-6d4d-4ad2-83f3-11c2984e3408 None None] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:30:29.525150 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-6cfc0f58-6d4d-4ad2-83f3-11c2984e3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:30:29.604325 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc0f58-6d4d-4ad2-83f3-11c2984e3408 None None] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:30:29.609987 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0591179ec144f5a90c9a24205b6b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:30:29.610960 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:30:29.611265 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:30:29.611545 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:30:29.613341 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:30:29.626967 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:30:29.629039 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:30:29.641136 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1462/2907] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:30:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:30:39.636316 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=34 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:41.068254 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab346c-9936-47b7-bcc2-820961971aa3 None None] REQUEST_METHOD: `POST` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:30:41.068770 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab346c-9936-47b7-bcc2-820961971aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:30:41.068884 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab346c-9936-47b7-bcc2-820961971aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:30:41.085725 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.auth.core [None req-ccab346c-9936-47b7-bcc2-820961971aa3 None None] MFA Rules not processed for user `b9fc9578e2ca4c9da1724ad0a22eedb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:30:41.086915 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-ccab346c-9936-47b7-bcc2-820961971aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:30:41.094105 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1446/2908] 10.222.0.13 () {58 vars in 957 bytes} [Thu Jun 2 10:30:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:30:51.080783 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=3 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:31:50.559252 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:31:50.560663 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:31:50.629452 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a8fb9-0c93-4531-b68a-8d84339f62b7 service nova] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:31:50.634426 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1a76-4b9a-4c8a-8f4e-af3a1d4c3162 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:31:50.635185 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1a76-4b9a-4c8a-8f4e-af3a1d4c3162 service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:31:50.635476 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1a76-4b9a-4c8a-8f4e-af3a1d4c3162 service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:31:50.635752 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1a76-4b9a-4c8a-8f4e-af3a1d4c3162 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:31:50.637499 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-bb3b1a76-4b9a-4c8a-8f4e-af3a1d4c3162 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:31:50.648760 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1a76-4b9a-4c8a-8f4e-af3a1d4c3162 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:31:50.650391 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1a76-4b9a-4c8a-8f4e-af3a1d4c3162 service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:31:50.660543 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1463/2909] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:31:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:31:50.662535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab346c-9936-47b7-bcc2-820961971aa3 None None] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:31:50.676861 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab346c-9936-47b7-bcc2-820961971aa3 None None] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:31:50.682236 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:31:50.683392 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:31:50.683569 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:31:50.683814 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] PATH_INFO: `/v3/users/b9fc9578e2ca4c9da1724ad0a22eedb1` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:31:50.685017 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9fc9578e2ca4c9da1724ad0a22eedb1)` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:31:50.687298 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:31:50.858850 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9fc9578e2ca4c9da1724ad0a22eedb1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:50.859535 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9fc9578e2ca4c9da1724ad0a22eedb1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:50.871787 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9fc9578e2ca4c9da1724ad0a22eedb1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:50.878510 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9fc9578e2ca4c9da1724ad0a22eedb1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:50.879232 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.notifications [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9fc9578e2ca4c9da1724ad0a22eedb1'} {{(pid=80296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:50.979831 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1447/2910] 10.222.0.13 () {58 vars in 1223 bytes} [Thu Jun 2 10:31:50 2022] DELETE /identity/v3/users/b9fc9578e2ca4c9da1724ad0a22eedb1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:31:51.248102 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1a76-4b9a-4c8a-8f4e-af3a1d4c3162 service placement] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:31:51.259000 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1a76-4b9a-4c8a-8f4e-af3a1d4c3162 service placement] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:31:51.315568 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee8c41befe5418c95bad9a434d99f95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4fcfbbe473b47bea6be4001c8a8fd93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:31:51.316421 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:31:51.316697 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:31:51.316966 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] PATH_INFO: `/v3/projects/736e2ca9b4c0467bb1a424fa187f05fc` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:31:51.318119 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=736e2ca9b4c0467bb1a424fa187f05fc)` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:31:51.320050 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:31:51.432367 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736e2ca9b4c0467bb1a424fa187f05fc', 'request_id': 'req-ea262a94-7e23-4657-ad8e-5bccba36e3d8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:51.438355 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736e2ca9b4c0467bb1a424fa187f05fc', 'request_id': 'req-ea262a94-7e23-4657-ad8e-5bccba36e3d8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:51.490280 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736e2ca9b4c0467bb1a424fa187f05fc', 'request_id': 'req-ea262a94-7e23-4657-ad8e-5bccba36e3d8'} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:51.501320 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] The token cache is being invalidate because project 736e2ca9b4c0467bb1a424fa187f05fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:31:51.501606 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:51.502239 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.notifications [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:31:51.503805 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1464/2911] 10.222.0.13 () {58 vars in 1232 bytes} [Thu Jun 2 10:31:51 2022] DELETE /identity/v3/projects/736e2ca9b4c0467bb1a424fa187f05fc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:32:00.975523 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:32:01.498120 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG dbcounter [-] [80295] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:32:15.244854 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] Authenticating user token {{(pid=80296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:32:15.249713 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:32:15.316456 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901554c-0c93-49f4-b465-2690bdc2c1c9 admin admin] Validating token access rules against request {{(pid=80296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:32:15.376455 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cfec4-6aa0-4d51-9af5-fd3d03acf43f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:32:15.377102 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cfec4-6aa0-4d51-9af5-fd3d03acf43f service placement] REQUEST_METHOD: `GET` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:32:15.377384 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cfec4-6aa0-4d51-9af5-fd3d03acf43f service placement] SCRIPT_NAME: `/identity` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:32:15.377660 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cfec4-6aa0-4d51-9af5-fd3d03acf43f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:32:15.379504 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.fernet_utils [None req-a21cfec4-6aa0-4d51-9af5-fd3d03acf43f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:32:15.391460 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cfec4-6aa0-4d51-9af5-fd3d03acf43f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:32:15.393035 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cfec4-6aa0-4d51-9af5-fd3d03acf43f service placement] RBAC: Authorization granted {{(pid=80296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:32:15.403046 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: [pid: 80296|app: 0|req: 1448/2912] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:32:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:32:25.398621 dv-cinder-797608-25-iscsi devstack@keystone.service[80296]: DEBUG dbcounter [-] [80296] Writing DB stats keystone:SELECT=58 {{(pid=80296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:37:18.290286 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] Authenticating user token {{(pid=80295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:37:18.291729 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.fernet_utils [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:37:18.383622 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea262a94-7e23-4657-ad8e-5bccba36e3d8 admin admin] Validating token access rules against request {{(pid=80295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:37:18.388880 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825289ae-608a-4bee-8289-0077f6eed0eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef7eacc5dc0445fa3297db10c8b4d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4933deccae2a46cc94f52fe67bd991a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:37:18.389531 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825289ae-608a-4bee-8289-0077f6eed0eb service placement] REQUEST_METHOD: `GET` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:37:18.389812 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825289ae-608a-4bee-8289-0077f6eed0eb service placement] SCRIPT_NAME: `/identity` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:37:18.390083 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825289ae-608a-4bee-8289-0077f6eed0eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:37:18.399641 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825289ae-608a-4bee-8289-0077f6eed0eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:37:18.401358 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825289ae-608a-4bee-8289-0077f6eed0eb service placement] RBAC: Authorization granted {{(pid=80295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:37:18.411255 dv-cinder-797608-25-iscsi devstack@keystone.service[80295]: [pid: 80295|app: 0|req: 1465/2913] 10.222.0.13 () {60 vars in 1365 bytes} [Thu Jun 2 10:37:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)